Push to Prod for CS Team

Table of Contents

Pushing Data to Prod Pushing Data to Prod for Select Months Pushing Data to Prod for Part of a Group Troubleshooting Push to Prod I changed my dealer to Approved for Prod but the Processing Status was cleared (is now blank). If the item was in the Onboarding group: If the Item was in the Hold or Inactive group I changed my dealer to Approved for Prod but the Processing Status flipped back to CSL QA. I changed my dealer to Approved for Prod awhile ago but it is still in Approved for Prod status I changed my dealer to Approved for Prod but it has been in Prod In Progress status for a long time Processing is being held up by 1 rooftop's data, but I want the rooftops that are ready pushed to Prod

This article applies to MTSA dealers with subscriptions: Pro, Pro+, Canada, Limited Study.
Source Reports (Source Reports) data is “always live” in the Dashboard so there is no need to push those properties' data to Prod.

Do NOT make any changes to the Ops Overview board on the last business day of the month.
Board Resets are performed on the last business day each month, so any changes made may cause problems with resetting the data for the following month, or may be lost and not take effect.

Pushing Data to Prod

What: SA data is always visible to Clarivoy employees in the Stage Dashboard and in Looker for QA at all times. However, each month's data is not visible to a dealer until it is “Pushed to Prod”. Push to Prod is a process where a dealer's Sales Attribution data is made live in Clarivoy's Prod Dashboard. This process must be performed for each month of reporting and each property/reporting group.

Where/Who: On the SA + TVA Ops Overview board, dealer items in the Active group can be approved for Prod.
You cannot push an item in the Onboarding group to Prod (the Prod process only looks at items in the Active group). Items will automatically move from the Onboarding group to the Active group once Onboarding integration is complete (this is done by Rocketlane). Do not move items prematurely from the Onboarding to Active group as this can cause unintended problems.

CSL or CS Specialist performs CSL QA and approves the data
Find the Ops Overview item and set the Processing Status to Approved for Prod
🤖 The Push to Prod process (auto_push_to_prod) will run automatically at the following times:
1. Mid-Day - The mid-day Push to Prod process will not start on time if nightly processing is still running from the day before.
  1. Standard Time (Nov-Mar) = At 11:00 AM EST and 5:00 PM EST daily
  2. Daylight Saving Time (Mar-Nov) =At 12:00 PM and 6:00 PM EST daily
2. Overnight - As part of the nightly run (which includes Matching, Clicktrails, Prod, Dashboard Refresh, Looker Refresh). This process kicks off at 6:00 PM EST daily, but can take 12 hours to 2 days to complete.
The Push to Prod process can take from 1 to 12 hours to complete, depending on how much data is being processed on our servers at the time.
🤖 The Push to Prod process (auto_push_to_prod) will do the following:
As long as the nightly run has finished/is not still running (failsafe check on sa_refresh_prod_dashboard DAG),
1. Insert the appropriate rows into the sales.production_ready table for all items where Ops Overview Processing status=“Approved for Prod”
2. Change the Processing Status of these items to Prod In Progress.
3. Alerts appear in Slack #airflow-alerts only if there is a failure.
4. * If the nightly run is still running (failsafe check on sa_refresh_prod_dashboard DAG), then auto_push_to_prod will fail and new properties will not be pushed to Prod at this time. You will have to wait until the nightly run at 5:00 PM EST.
🤖 The nightly SA Matching run will do the following:
As of October 2024, we have seen nightly Matching/Prod runs take up to 2 days to complete. Per Engineering, “this is the new norm”.
1. Overnight - approx. 3-4:00 AM EST = sa_refresh_prod_dashboard will refresh the dashboard and actually publish the data in the Prod Dashboard.
2. If the run is successful, Once completed, it will change the Processing Status of these items to Verify Prod
  1. 🚨 This triggers a Monday automation to create an item on the CS Monthly Processing board
  2. 🚨 This triggers a Monday automation to set the Reporting Status to Done. This status column is used in the CS Dashboard for reporting purposes.
3. Usually takes 1-3 hours to run, but can take longer if system resources are being strained. Alert in both Slack channels #salesattribution and #customersuccess if Success or Failure.

Pushing Data to Prod for Select Months

Under our normal process: If there are multiple months listed in the Processing Months column, we will wait until we have complete data for all months listed to proceed to QA and eventually Prod.

Sometimes a CSL may choose to push an older month (whose data is usually complete) to Prod and not wait until we receive the most recent month's data. If you wish to Push data to Prod for Select Months only, follow this process.

An example of when to use this scenario would be: If a dealer did not turn in a collect file until the last few days of a month (e.g. August 2024), then processing could not complete before the end of the month. In this case, the board gets reset on 9/1/24 and September 2024 is added to the dealer's Processing Month column. Under our normal processes, we would not push the previous month data (August 2024) to Prod until the next month's data is also ready (September 2024). A CSL may wish to have the previous month (August 2024) data pushed to Prod before the following month's data is ready (September 2024).

QA the data using CS QA and other Looker boards to ensure the data appears ready to you.
Locate the dealer's item on the SA + TVA Ops Overview board.
Note which months are in the Processing Month column for this dealer.
Note what the current Processing Status is. You'll need to know this for the last step!
What is the current Processing Status?
1. Prod In Progress - you MUST wait until the item is in Verify Prod status before you can make any changes (usually the next morning). Once it is in Verify Prod status, change the Processing Status back to Working On It before continuing.
2. Verify Prod - change the Processing Status back to Working On It before continuing.
3. Anything else - continue
Remove the month(s) you do NOT want pushed to Prod at this time (usually the most recent processing month), leaving only the month(s) you want pushed.
Change Processing Status to Approved for Prod.
Wait for the Push to Prod process to complete. This can take up to 12 hours once started and may not always start at the scheduled time if nightly processing has not yet completed from the previous night. Once the Push to Prod process is completed, the dealer's item will have a Processing Status of Verify Prod.
Once the dealer is in Verify Prod status, reset processing for the months we still need to process:
1. FIRST: Set the Processing Status back to its initial value (usually Working On It)
2. THEN: Clear the Processing Month column, removing all months that were just pushed to Prod.
3. FINALLY: Add back in the month(s) that you removed at the beginning (the months we still need to process; usually the most recent processing month).

It is VERY IMPORTANT you watch for the Ops Overview item to flip to Verify Prod and follow all steps under Step 9 to reset processing. Failure to follow this step will result in data never being pushed to Prod for the month(s) you removed [usually the most recent month].

Pushing Data to Prod for Part of a Group

As of October 2025, all groups have been split into individual items on the Ops Overview board. Each item on Ops Overview represents an individual property. To push part of a group to Prod, simply set the Processing Status to “Approved for Prod” for only those rooftops whose data you wish to send to Prod.

Troubleshooting Push to Prod

I changed my dealer to Approved for Prod but the Processing Status was cleared (is now blank).

If this happens, the item was most likely in the Onboarding, Hold, or Inactive group. The Prod process only looks at items in the Active group. Check the item's updates to see if an update was created with an error message.

If the item was in the Onboarding group:

Items will automatically move from the Onboarding group to the Active group once Onboarding integration is complete (this is done by Rocketlane). Do not move items prematurely from the Onboarding to Active group as this can cause unintended problems. If you need to mark an Onboarding project as Integration Complete:

Go to the Rocketlane project
Verify that all Core Data tasks are complete (DMS, CRM, Call Tracking, Chat).
Go to the project Overview → Project Info, and change the project Status to Integration Complete/Processing 1st Month.
1. 🚀 This will trigger a Rocketlane/Monday integration to set the Ops Overview item to Waiting on 1st Month.
2. If the Start Date has already passed, the following morning, 🚦Make will change the status to Working On It Future improvement: Have Make flip the status instantly to Working on It
  1. 🚨 Monday automations will move the item to the Active group

If the Item was in the Hold or Inactive group

1. You must move the item to the Active group first.
2. Ensure properties are linked
3. Ensure Processing Months are filled in
4. Now you are ready to Approve for Prod

I changed my dealer to Approved for Prod but the Processing Status flipped back to CSL QA.

If this happens, the Processing Month was most likely empty. We cannot push a property to Prod without Processing Month(s) being specified. Check the item's updates to see if an update was created with an error message.

(This usually happens when someone manually moves an item from the Onboarding group to Active without adding the Processing Month.)

1. Add the appropriate months to the Processing Months column.
2. Set the Processing Status back to Approved for Prod.

I changed my dealer to Approved for Prod awhile ago but it is still in Approved for Prod status

FIRST - Check to ensure there is at least one month in the Processing Month column. If there is no Processing Month, the item cannot be pushed to Prod.

Add the Processing Month(s) you need pushed to Prod.
Set Processing Status to Approved for Prod again

If you had a Processing Month in the column, then the Prod process either:

Has not started yet (delayed due to nightly processing still running from the night before)
Has not completed yet
or Failed

Here is how to check on the Prod process:

Check the #salesattribution Slack channel
Look for an update with a time AFTER you approved the dealer for Prod that reads:
  job:        daily_sa_refresh_prod_dashboard
or    job:        SA_Refresh_Prod_Dashboard
with status:    PASS
If there is no update like this yet, then either:
1. Prod has not started due to nightly processing (matching/clicktrails/Chartio [Looker] refresh) from the night before taking a long time. Prod will not start while nightly processing is still running. Be patient and continue to wait.
2. OR Prod has started but not finished yet and is taking a long time. Prod can take up to 12 hours to complete from the time it starts. Be patient and continue to wait.
If there is an update with status: FAIL, then the Prod process failed. Alert Engineering (Matt Dailey).

If you still have concerns or questions, contact Engineering (Matt Dailey).

I changed my dealer to Approved for Prod but it has been in Prod In Progress status for a long time

The Prod process has not completed yet or has failed. Here is how to check:

Check the #salesattribution Slack channel
Look for an update with a time AFTER you approved the dealer for Prod that reads:
  job:        daily_sa_refresh_prod_dashboard
or    job:        SA_Refresh_Prod_Dashboard
with status:    PASS
If there is no update like this yet, then Prod has started but not finished yet and is taking a long time. Prod can take up to 12 hours to complete from the time it starts. Be patient and continue to wait.
If there is an update with status: FAIL, then the Prod process failed. Alert Engineering (Matt Dailey).