This step follows Manually Generating Audience Files in TreasureData and LiveRamp Refresh Audience Process (Confluence).

Automated Process

1. 🚦 The Make scenario CDP Lite Audiences - Daily: add unlogged Monday deliveries (last 7 days) to Google Sheet (6 AM ET) runs every day at 6:00 AM ET:
   1. Finds items on the CDP Lite Manual Audience Processing board that meet both conditions:
      1. their Last Updated Date is in the last 7 days, up to yesterday;
      2. their Sheet Logged Date doesn't match their Last Updated Date, so they haven't been logged yet.
      3. The weekly audience refresh sets Last Updated Date on Wednesday, so refreshed audiences are picked up on Thursday morning.
   2. Adds one row per item to the AB manual updates for Dashboard Google Sheet, with these values:
      1. Mirror Property ID;
      2. item name;
      3. Domain;
      4. Inserted: FALSE, which marks the row for the dashboard load in step 2;
      5. Segment;
      6. Destination;
      7. Last Updated Date;
      8. Audience Name;
      9. IDs Shared Last Update;
      10. N/A in the last two columns.
   3. Sets the item's Sheet Logged Date to its Last Updated Date, so the item isn't added twice.
2. Dashboard Population Process: ⚙️ The Airflow DAG insert_ab_manually_to_reporting runs every day at 3:00 AM EST/4:00 AM EDT.  This DAG:
   1. Reads the sheet rows where Inserted is FALSE, one audience type at a time: web, sales, leads, then service_targets.
   2. Matches each row's audience details with its delivery IDs and identifiers.
   3. Loads the rows into dashboard_data.rfm_reporting in the PostgreSQL database.
   4. 📧 Sends the weekly pending status summaries through SendGrid.
   5. The DMUI / Audience Booster Dashboard reads this table to show dealers their audience counts, match details, delivery dates and sharing status.
3. Verify Google Sheet Logging:  Check that each refreshed audience was logged, and fix any that weren't:      To discuss -  is this necessary?  If yes, we can automate it
   1. After 6:00 AM the day after a refresh, each item's Sheet Logged Date should match its Last Updated Date.
   2. To log an item again: clear its Sheet Logged Date. The next 6:00 AM run adds it again, as long as its Last Updated Date is within the last 7 days.
   3. To correct a value that's already logged: the sheet doesn't change when the board changes later. Edit the row in the sheet directly while Inserted is still FALSE.
   4. If the Make scenario was off for more than 7 days: it won't pick up refreshes older than 7 days, so add those rows to the sheet by hand.
4. Final Steps - QA Reporting data in the Dashboard:     To discuss -  is this done/necessary?
   • Sean recommended going into the dashboard, viewing "audiences" and "delivery," and spot-checking a few audiences.