Skip to content

Commit

Permalink
Update the search docs related to mobile baseline switch (#838)
Browse files Browse the repository at this point in the history
* Update the search docs related to mobile baseline switch

* Fix spelling error

Fix spelling error

* Fix spelling error

* More technical detals, different links

* Making the dates a bit clearer

* Fix prettier check issue

* Fix prettier check issue

---------

Co-authored-by: skahmann3 <[email protected]>
  • Loading branch information
alekhyamoz and skahmann3 authored Jul 30, 2024
1 parent 5500cc9 commit ce13ee0
Showing 1 changed file with 6 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -48,4 +48,10 @@ This dataset is large.
If you're querying this dataset from STMO,
heavily limit the data you read using `submission_date` or `sample_id`.

As of August 1, 2024, the `mobile_search_clients_daily` table has been updated to extract data from the `baseline` ping tables instead of the original `metrics` ping tables. This shift maintains the same search totals with greater confidence in the mobile search engagement dates.

As [noted](https://docs.telemetry.mozilla.org/concepts/analysis_gotchas.html?highlight=submission)#submission-date), the `submission_date` used throughout telemetry is the date Mozilla received that client's engagement, not necessarily the actual date on which that client engaged with Firefox. Mobile `metrics` pings are historically sent later than the actual date of activity: it takes roughly [4 days for Firefox to receive 95% of Fenix `metrics` pings](https://sql.telemetry.mozilla.org/queries/92717) which originate from a given actual date. `Baseline` pings are more frequently sent/ received and serve as the basis of KPI DAU metrics. Therefore, this switch ensures a client's KPI DAU activity can be matched to search activity from that same active day.

All data prior to August 1st, 2024, is powered by the `metrics` ping and has been moved to the `mobile_search_clients_daily_historical` table. The new derived table, `mobile_search_clients_daily_v2`, has data from August 1, 2024 and is powered by the `baseline` ping. Downstream views and tables, like `mozdata.search.mobile_search_clients_daily`, pull data from both `mobile_search_clients_daily_v2` and `mobile_search_clients_daily_historical` to ensure comprehensive data coverage. `mozdata.search.mobile_search_clients_daily` remains the client-level source-of-truth for mobile search analyses.

[search data documentation]: ../../search.md

0 comments on commit ce13ee0

Please sign in to comment.