mirror of
https://github.com/discourse/discourse.git
synced 2026-08-05 15:18:34 +08:00
bf8d011bddPreviously, CrawlerScorer wrote a score to every browser pageview event, but nothing consumed it, so the site traffic chart still counted automated sessions as logged-in or anonymous humans and overstated community traffic. Classify events scoring above CrawlerScorer::BOT_SCORE_THRESHOLD, as likely crawlers. Their daily counts are rolled up per logged-in state into a new browser_pageview_crawler_daily_rollups table, subtracted from the logged-in and anonymous series, and shown as their own "Likely crawlers" series ahead of the known-crawler one. All of this sits behind the new improved_crawler_detection upcoming change, which also replaces experimental_detect_crawler_pageviews as the gate on scoring. The rollup job backfills all existing history on its first run, then refreshes yesterday and today. Disabling the change restores the original counters and hides the series while leaving the rollups in place, so re-enabling takes effect without a backfill. <img width="993" height="755" alt="Screenshot 2026-07-31 at 12 22 13 pm" src="https://github.com/user-attachments/assets/6163b731-c2ba-4e53-8cc7-4eba78f4190d" /> |
||
|---|---|---|
| .. | ||
| 20260112082200_drop_reviewable_action_logs.rb | ||
| 20260311064518_clean_existing_tag_localization_names.rb | ||
| 20260319054730_delete_redundant_everyone_posting_review_groups.rb | ||
| 20260319054731_drop_permission_from_category_posting_review_groups.rb | ||
| 20260330161714_drop_pinned_post_number_from_nested_topics.rb | ||
| 20260422135650_strip_upload_label_escapes.rb | ||
| 20260512061336_convert_reporting_improvements_everyone_to_staff.rb | ||
| 20260601043020_rename_anonymous_auto_group_to_anonymous_users.rb | ||
| 20260602104726_recalculate_topic_counters_without_small_actions.rb | ||
| 20260603115312_remove_admin_dashboard_sections_setting.rb | ||
| 20260607161322_move_unified_new_setting_from_groups.rb | ||
| 20260624140945_ensure_unique_flag_name_keys.rb | ||
| 20260629081606_remove_reporting_improvements_setting.rb | ||
| 20260702102111_remove_create_revision_on_bulk_topic_moves_setting.rb | ||
| 20260707184150_backfill_push_notification_level.rb | ||
| 20260721122254_remove_rich_editor_setting.rb | ||
| 20260728050038_remove_experimental_detect_crawler_pageviews_setting.rb | ||
| 20260728162521_backfill_send_shortcut.rb | ||
