News/Event Training Coverage: 2026-07-13
Run: news_training_coverage_20260720T054509Z
This report tracks whether the news/event data lake is filling at the raw API, normalized evidence, and matured outcome layers.
Summary
- Canonical article rows:
1,876,996 across 2,400 symbols from 2016-07-15 00:00:00+00:00 to 2026-07-16 20:45:55.353986+00:00 - Canonical event rows:
1,683,534 across 2,367 symbols from 2016-07-15 00:00:00+00:00 to 2026-07-16 20:45:55.353986+00:00 - Canonical forecast evidence rows:
1,119,859 - Matured forecast outcome rows:
3,336,202 - Event taxonomy rows:
1,683,534 across 14 event keys and 7 publisher classes - Average source/entity/confidence quality:
0.6352 / 0.9964 / 0.6021 - Review-quality rows: low source quality
183,654, low entity relevance 7,616, low confidence 230,150, unknown publisher 2,591, true repeated clusters 48,928 with 1,017,451 extra article rows
News Model Use Policy
This is a report-only guardrail. It translates source quality, classification quality, duplicate pressure, and matured forecast outcomes into how news/event evidence may be used by research models.
| Policy Area | Status | Observed | Required/Context | Gap/Review Rows | Ratio | Model Usage Policy | Operator Action |
|---|
| factual_event_training_evidence | research_feature_candidate | 563675 | 1683534 | 1119859 | 0.3348 | research_feature_candidate_not_promotion_permission | Use factual/mixed event rows as research features only after source, entity, confidence, and duplicate gates are applied. |
| classification_quality_gate | classification_review_required | 1259523 | 1683534 | 424011 | 0.7481 | downweight_or_exclude_review_buckets | Downweight or exclude buckets with low source quality, low entity relevance, low confidence, or unknown publisher class before model weighting. |
| duplicate_cluster_handling | dedupe_required_before_weighting | 48928 | 1683534 | 48928 | 0.0291 | dedupe_cluster_cap_before_weighting | Cap repeated article clusters so one syndication wave cannot dominate an event signal. |
| publisher_source_quality_gate | source_quality_usable_with_reviews | 1499880 | 1683534 | 183654 | 0.8909 | source_weighting_candidate_with_unknowns_reviewed | Keep publisher/source-class weights visible; unknown or low-quality publisher classes need review before gaining weight. |
| opinion_forecast_track_record | forecast_track_record_research_candidate | 3336202 | 1119859 | 0 | 1.0000 | track_record_overlay_only_not_factual_truth | Treat opinion/forecast rows as reliability-overlay candidates only; do not mix them into factual event truth. |
| aggregate_news_signal_policy | news_signal_research_only_quality_review | 1259523 | 1683534 | 607665 | 0.7481 | research_only_until_lift_and_promotion_gates_pass | Use the news signal in research/ablation only until lift, leakage, stability, and promotion gates pass. |
Raw Coverage By Plan
| Plan | Coverage Rows | Symbols | Min Start | Max End | Succeeded | Empty | Failed | Raw Bytes |
|---|
| benzinga_newsfeed_daily | 600 | 519 | 2026-07-02 | 2026-07-16 | 1 | 599 | 0 | 28695 |
| benzinga_newsfeed_recent_backfill | 2712 | 424 | 2023-01-01 | 2026-07-15 | 90 | 2622 | 0 | 13111534 |
| fmp_grades_consensus_research_pool | 13166 | 1370 | 2026-06-03 | 2026-07-16 | 12869 | 297 | 0 | 1815904 |
| fmp_grades_historical_research_pool | 2250 | 1157 | 2016-06-05 | 2026-06-20 | 2246 | 4 | 0 | 37880578 |
| fmp_grades_research_pool | 13166 | 1370 | 2026-06-03 | 2026-07-16 | 12843 | 323 | 0 | 381606271 |
| fmp_press_releases_recent_backfill | 3186 | 789 | 2026-01-10 | 2026-07-13 | 2057 | 1129 | 0 | 11280067 |
| fmp_press_releases_research_pool | 13166 | 1370 | 2026-06-03 | 2026-07-16 | 13049 | 117 | 0 | 131998638 |
| fmp_price_target_consensus_research_pool | 13166 | 1370 | 2026-06-03 | 2026-07-16 | 12405 | 761 | 0 | 1590660 |
| fmp_price_target_summary_research_pool | 13166 | 1370 | 2026-06-03 | 2026-07-16 | 12405 | 761 | 0 | 4285554 |
| fmp_stock_news_historical_backfill | 223559 | 2114 | 2011-01-01 | 2026-07-13 | 86717 | 136842 | 0 | 1543138930 |
| fmp_stock_news_research_pool | 12416 | 1393 | 2026-06-02 | 2026-07-02 | 12294 | 122 | 0 | 304233577 |
Source Family Coverage
This rollup groups raw coverage plans into provider/source families so Benzinga, FMP stock news, issuer press releases, and analyst-action feeds can be reviewed separately before increasing source weight or backfill volume.
| Source Family | Plans | Coverage Rows | Symbols | Min Start | Max End | Succeeded | Empty | Failed | Raw Bytes | Operator Action |
|---|
| FMP stock news | fmp_stock_news_historical_backfill, fmp_stock_news_research_pool | 235975 | 3507 | 2011-01-01 | 2026-07-13 | 99011 | 136964 | 0 | 1847372507 | coverage available; monitor source quality and outcome maturity |
| FMP analyst actions | fmp_grades_consensus_research_pool, fmp_grades_historical_research_pool, fmp_grades_research_pool, fmp_price_target_consensus_research_pool, fmp_price_target_summary_research_pool | 54914 | 6637 | 2016-06-05 | 2026-07-16 | 52768 | 2146 | 0 | 427178967 | use as forecast/opinion evidence and keep track-record calibration visible |
| FMP press releases | fmp_press_releases_recent_backfill, fmp_press_releases_research_pool | 16352 | 2159 | 2026-01-10 | 2026-07-16 | 15106 | 1246 | 0 | 143278705 | use as issuer event evidence; watch duplicate clusters before weighting |
| Benzinga market news | benzinga_newsfeed_daily, benzinga_newsfeed_recent_backfill | 3312 | 943 | 2023-01-01 | 2026-07-16 | 91 | 3221 | 0 | 13140229 | validate Benzinga event taxonomy/source quality against FMP and matured outcomes |
News History Expansion Priorities
This derived queue ranks the next bounded news-history work from local coverage and quality evidence. It is guidance only: it does not call providers or queue tasks.
| Priority | Expansion Area | Status | Observed | Required/Target | Gap/Review | Suggested Scope | Operator Action |
|---|
| 1 | benzinga_licensed_market_news_validation | benzinga_validation_seed_sparse | 91 | 500 | 409 | targeted_top_candidate_windows_not_broad_empty_retries | Use bounded Benzinga windows on current opportunity, stop-loss, and sector-exposure candidates; compare taxonomy/source quality before increasing source weight. |
| 2 | fmp_stock_news_historical_depth | fmp_historical_stock_news_depth_gap | 99011 | 100000 | 989 | window_first_historical_stock_news_months | Continue window-first historical stock-news backfill for sparse or underfilled years before asking for new paid news sources. |
| 4 | sparse_backfill_month_review | sparse_backfill_months_present | 6 | 0 | 6 | review_months_before_repeating_provider_calls | Review sparse months before rerunning them, so known-empty windows do not consume daily/provider capacity. |
| 6 | classification_and_duplicate_review_pressure | classification_review_pressure_present | 472939 | 0 | 472939 | review_quality_buckets_before_source_weight_increase | Clean or downweight review-heavy buckets before giving new backfilled news more model influence. |
| 6 | factual_event_depth | factual_event_depth_ready | 563675 | 505060 | 0 | issuer_press_release_trusted_market_reporting_sec_event_sources | Factual/mixed event share is adequate for research; keep classification and duplicate gates active. |
| 8 | normalized_event_month_depth | normalized_event_month_depth_ready | 18 | 18 | 0 | extend_training_history_months_after_raw_backfill | Normalized event months are broad enough for this report window; use outcome and quality gates to steer expansion. |
Stock-News Backfill Months
| Month | Windows | Symbols | Succeeded | Raw Bytes |
|---|
| 2026-07-01 | 1017 | 895 | 184 | 310904 |
| 2026-06-01 | 1198 | 983 | 803 | 8009859 |
| 2026-05-01 | 4472 | 2031 | 2562 | 28841208 |
| 2026-04-01 | 3213 | 2031 | 2031 | 33755713 |
| 2026-03-01 | 2286 | 1174 | 1165 | 20693705 |
| 2026-02-01 | 117 | 83 | 25 | 1256658 |
| 2026-01-01 | 4459 | 1174 | 2324 | 42584017 |
| 2025-12-01 | 1067 | 1007 | 638 | 2465268 |
| 2025-11-01 | 1395 | 1011 | 1000 | 15915833 |
| 2025-10-01 | 2250 | 1159 | 1166 | 20798351 |
| 2025-09-01 | 2221 | 1159 | 1147 | 14471278 |
| 2025-08-01 | 2530 | 1170 | 1050 | 11581963 |
| 2025-07-01 | 2909 | 1173 | 1125 | 16592912 |
| 2025-06-01 | 2152 | 1152 | 1121 | 15175250 |
| 2025-05-01 | 4304 | 1152 | 2130 | 29512223 |
| 2025-04-01 | 2152 | 1152 | 1128 | 16620512 |
| 2025-03-01 | 2152 | 1152 | 1053 | 12524659 |
| 2025-01-01 | 4304 | 1152 | 2205 | 32969473 |
Normalized Event Months
| Month | Event Rows | Symbols | Opinion Rows | Factual/Mixed Rows |
|---|
| 2026-07-01 | 7099 | 1585 | 4231 | 2868 |
| 2026-06-01 | 25965 | 2099 | 11148 | 14817 |
| 2026-05-01 | 37067 | 2219 | 19285 | 17782 |
| 2026-04-01 | 37279 | 2125 | 19179 | 18100 |
| 2026-03-01 | 24759 | 1393 | 12080 | 12679 |
| 2026-02-01 | 31601 | 1341 | 18974 | 12627 |
| 2026-01-01 | 27875 | 1334 | 16911 | 10964 |
| 2025-12-01 | 20525 | 1259 | 11374 | 9151 |
| 2025-11-01 | 24119 | 1297 | 14136 | 9983 |
| 2025-10-01 | 28324 | 1375 | 19230 | 9094 |
| 2025-09-01 | 17223 | 1262 | 10694 | 6529 |
| 2025-08-01 | 22392 | 1348 | 14825 | 7567 |
| 2025-07-01 | 25902 | 1330 | 18364 | 7538 |
| 2025-06-01 | 15212 | 1250 | 8450 | 6762 |
| 2025-05-01 | 26737 | 1300 | 17640 | 9097 |
| 2025-04-01 | 29496 | 1284 | 20384 | 9112 |
| 2025-03-01 | 18133 | 1262 | 10540 | 7593 |
| 2025-02-01 | 26278 | 1286 | 16818 | 9460 |
Event Taxonomy And Source Quality
| Event Key | Family | Kind | Publisher Class | Rows | Symbols | Low Source | Low Entity | Low Confidence | Unknown Publisher | True Duplicate Clusters | Extra Duplicate Articles | Avg Confidence | Avg Source Quality | Avg Entity Relevance |
|---|
| analyst_revision | analyst_revision | opinion_forecast | analyst_forecaster | 1071572 | 1362 | 0 | 0 | 76218 | 0 | 48660 | 1017152 | 0.5592 | 0.6200 | 1.0000 |
| issuer_release | issuer_release | factual_event | issuer_wire_release | 191739 | 2219 | 0 | 1200 | 0 | 0 | 0 | 0 | 0.7497 | 0.7000 | 0.9919 |
| legal_regulatory | regulatory | factual_event | issuer_wire_release | 56489 | 1331 | 0 | 206 | 0 | 0 | 0 | 0 | 0.7459 | 0.7000 | 0.9948 |
| product_contract_partnership | product_contract | factual_event | issuer_wire_release | 40807 | 1522 | 0 | 281 | 0 | 0 | 0 | 0 | 0.7471 | 0.7000 | 0.9914 |
| earnings_result | earnings | factual_event | market_analysis | 32204 | 2050 | 32204 | 110 | 32194 | 0 | 0 | 0 | 0.5205 | 0.5600 | 0.9940 |
| market_opinion | market_opinion | opinion_forecast | market_analysis | 26802 | 1704 | 26802 | 991 | 961 | 0 | 0 | 0 | 0.6179 | 0.5600 | 0.9798 |
| corporate_action | corporate_action | factual_event | market_analysis | 25384 | 1526 | 25384 | 173 | 25349 | 0 | 0 | 0 | 0.5217 | 0.5600 | 0.9927 |
| legal_regulatory | regulatory | factual_event | market_analysis | 22921 | 1471 | 22921 | 233 | 22303 | 0 | 0 | 0 | 0.5224 | 0.5600 | 0.9912 |
| capital_return | capital_return | factual_event | market_analysis | 20511 | 1183 | 20511 | 426 | 20341 | 0 | 0 | 0 | 0.5216 | 0.5600 | 0.9879 |
| financing_liquidity | financing_liquidity | factual_event | issuer_wire_release | 17933 | 1258 | 0 | 175 | 0 | 0 | 0 | 0 | 0.7467 | 0.7000 | 0.9923 |
| capital_return | capital_return | factual_event | issuer_wire_release | 17765 | 1359 | 0 | 42 | 0 | 0 | 0 | 0 | 0.7453 | 0.7000 | 0.9948 |
| corporate_action | corporate_action | factual_event | issuer_wire_release | 17138 | 1225 | 0 | 146 | 0 | 0 | 0 | 0 | 0.7447 | 0.7000 | 0.9916 |
| cybersecurity | cybersecurity | factual_event | issuer_wire_release | 15722 | 775 | 0 | 78 | 0 | 0 | 0 | 0 | 0.7439 | 0.7000 | 0.9932 |
| product_contract_partnership | product_contract | factual_event | market_analysis | 12494 | 1120 | 12494 | 348 | 12388 | 0 | 0 | 0 | 0.5196 | 0.5600 | 0.9815 |
| issuer_release | issuer_release | factual_event | market_analysis | 11933 | 1235 | 11933 | 299 | 11856 | 0 | 0 | 0 | 0.5194 | 0.5600 | 0.9801 |
| analyst_revision | analyst_revision | opinion_forecast | market_analysis | 9759 | 1375 | 9759 | 100 | 5125 | 0 | 0 | 0 | 0.5621 | 0.5600 | 0.9911 |
| labor_restructuring | operations | factual_event | issuer_wire_release | 7785 | 737 | 0 | 38 | 0 | 0 | 0 | 0 | 0.7447 | 0.7000 | 0.9930 |
| macro_sector | macro_sector | mixed_context | market_analysis | 6402 | 915 | 6402 | 462 | 6336 | 0 | 0 | 0 | 0.5166 | 0.5600 | 0.9683 |
| legal_regulatory | regulatory | factual_event | trusted_market_reporting | 6244 | 280 | 0 | 257 | 0 | 0 | 0 | 0 | 0.6985 | 0.8200 | 0.9800 |
| macro_sector | macro_sector | mixed_context | issuer_wire_release | 5084 | 523 | 0 | 21 | 0 | 0 | 0 | 0 | 0.7498 | 0.7000 | 0.9959 |
Classification Review Queue
This queue is derived from the event taxonomy aggregation above. It ranks event/publisher buckets where source quality, confidence, entity matching, unknown publisher classes, or true repeated article clusters should be reviewed before giving the signal more model weight. A populated cluster hash with only one article is not duplicate pressure.
| Event Key | Publisher Class | Kind | Review Rows | Low Source | Low Entity | Low Confidence | Unknown Publisher | True Duplicate Clusters | Bucket Rows | Operator Action |
|---|
| analyst_revision | analyst_forecaster | opinion_forecast | 76218 | 0 | 0 | 76218 | 0 | 48660 | 1071572 | tighten event-key terms or confidence thresholds; dedupe repeated article clusters before weighting |
| earnings_result | market_analysis | factual_event | 64508 | 32204 | 110 | 32194 | 0 | 0 | 32204 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| corporate_action | market_analysis | factual_event | 50906 | 25384 | 173 | 25349 | 0 | 0 | 25384 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| legal_regulatory | market_analysis | factual_event | 45457 | 22921 | 233 | 22303 | 0 | 0 | 22921 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| capital_return | market_analysis | factual_event | 41278 | 20511 | 426 | 20341 | 0 | 0 | 20511 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| market_opinion | market_analysis | opinion_forecast | 28754 | 26802 | 991 | 961 | 0 | 0 | 26802 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| product_contract_partnership | market_analysis | factual_event | 25230 | 12494 | 348 | 12388 | 0 | 0 | 12494 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| issuer_release | market_analysis | factual_event | 24088 | 11933 | 299 | 11856 | 0 | 0 | 11933 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| analyst_revision | market_analysis | opinion_forecast | 14984 | 9759 | 100 | 5125 | 0 | 0 | 9759 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| macro_sector | market_analysis | mixed_context | 13200 | 6402 | 462 | 6336 | 0 | 0 | 6402 | review source scoring; tighten event-key terms or confidence thresholds; inspect symbol/entity matching |
| issuer_release | issuer_wire_release | factual_event | 1200 | 0 | 1200 | 0 | 0 | 0 | 191739 | inspect symbol/entity matching |
| product_contract_partnership | issuer_wire_release | factual_event | 281 | 0 | 281 | 0 | 0 | 0 | 40807 | inspect symbol/entity matching |
Publisher Class Quality
| Publisher Class | Rows | Symbols | Forecast Rows | Forecast Origins | Avg Source Quality | Avg Entity Relevance | Avg Confidence |
|---|
| analyst_forecaster | 1076529 | 1362 | 1076529 | 305 | 0.6200 | 1.0000 | 0.5587 |
| issuer_wire_release | 374612 | 2242 | 0 | 8 | 0.7000 | 0.9926 | 0.7478 |
| market_analysis | 180565 | 2214 | 36561 | 43 | 0.5600 | 0.9868 | 0.5373 |
| trusted_market_reporting | 28996 | 756 | 2930 | 24 | 0.8200 | 0.9852 | 0.6956 |
| licensed_market_news | 19743 | 1297 | 3751 | 58 | 0.6800 | 0.9808 | 0.6623 |
| unknown | 2591 | 571 | 0 | 196 | 0.4500 | 0.9843 | 0.5896 |
| video_or_social_distribution | 498 | 173 | 88 | 9 | 0.3500 | 0.9449 | 0.5506 |
Matured Forecast Outcomes
| Horizon | Rows | Symbols | Min Published | Max Actual | Hit Rate | Signed Capture |
|---|
| 1 | 1114873 | 1393 | 2016-07-15 00:00:00+00:00 | 2026-07-17 | 0.5084 | 0.0007 |
| 5 | 1114138 | 1393 | 2016-07-15 00:00:00+00:00 | 2026-07-17 | 0.5223 | 0.0028 |
| 20 | 1107191 | 1391 | 2016-07-15 00:00:00+00:00 | 2026-07-17 | 0.5364 | 0.0102 |
Forecaster Track Record Readiness
| Sample Status | Horizon | Origin Rows | Matured Rows | Eligible Rows | Avg Hit Rate | Avg Signed Capture |
|---|
| review | 1 | 65 | 3858 | 52 | 0.5018 | -0.0001 |
| thin_sample | 1 | 181 | 1681 | 160 | 0.4812 | -0.0006 |
| trainable | 1 | 192 | 1109334 | 185 | 0.5050 | 0.0006 |
| review | 5 | 65 | 3858 | 52 | 0.4906 | -0.0003 |
| thin_sample | 5 | 178 | 1678 | 157 | 0.4255 | -0.0020 |
| trainable | 5 | 192 | 1108602 | 185 | 0.5198 | 0.0017 |
| review | 20 | 65 | 3836 | 52 | 0.4803 | 0.0013 |
| thin_sample | 20 | 171 | 1660 | 151 | 0.4886 | -0.0044 |
| trainable | 20 | 192 | 1101695 | 185 | 0.5208 | 0.0055 |
Largest Eligible Forecaster Samples
| Origin | Level | Organization | Author | Horizon | Event | Matured Rows | Symbols | Hit Rate | Signed Capture | Sample Status | Eligible |
|---|
| fmp_analyst_aggregation | organization | FMP analyst aggregation | n/a | 1 | analyst_revision | 93770 | 1361 | 0.5160 | 0.0013 | trainable | True |
| fmp_analyst_aggregation | organization | FMP analyst aggregation | n/a | 5 | analyst_revision | 93529 | 1351 | 0.5330 | 0.0051 | trainable | True |
| fmp_analyst_aggregation | organization | FMP analyst aggregation | n/a | 20 | analyst_revision | 92370 | 1176 | 0.5404 | 0.0141 | trainable | True |
| morgan_stanley | organization | Morgan Stanley | n/a | 5 | analyst_revision | 78667 | 613 | 0.5141 | 0.0019 | trainable | True |
| morgan_stanley | organization | Morgan Stanley | n/a | 1 | analyst_revision | 78667 | 613 | 0.5025 | 0.0002 | trainable | True |
| morgan_stanley | organization | Morgan Stanley | n/a | 20 | analyst_revision | 78568 | 613 | 0.5452 | 0.0097 | trainable | True |
| barclays | organization | Barclays | n/a | 1 | analyst_revision | 53602 | 656 | 0.5177 | 0.0011 | trainable | True |
| barclays | organization | Barclays | n/a | 5 | analyst_revision | 53600 | 656 | 0.5269 | 0.0028 | trainable | True |
| barclays | organization | Barclays | n/a | 20 | analyst_revision | 53548 | 656 | 0.5405 | 0.0092 | trainable | True |
| wells_fargo | organization | Wells Fargo | n/a | 1 | analyst_revision | 47959 | 612 | 0.5068 | 0.0008 | trainable | True |
| wells_fargo | organization | Wells Fargo | n/a | 5 | analyst_revision | 47956 | 612 | 0.5321 | 0.0045 | trainable | True |
| wells_fargo | organization | Wells Fargo | n/a | 20 | analyst_revision | 47892 | 611 | 0.5428 | 0.0118 | trainable | True |
| citigroup | organization | Citigroup | n/a | 1 | analyst_revision | 44237 | 637 | 0.5109 | 0.0010 | trainable | True |
| citigroup | organization | Citigroup | n/a | 5 | analyst_revision | 44236 | 637 | 0.5264 | 0.0027 | trainable | True |
| citigroup | organization | Citigroup | n/a | 20 | analyst_revision | 44147 | 636 | 0.5426 | 0.0115 | trainable | True |
Active/Queued News Tasks
| Plan | Status | Tasks |
|---|
| No active news tasks | | |
Operator Commands
.\scripts\run-news-event-historical-backfill.ps1 -PoolSize 50 -StartDate 2024-01-01 -EndDate 2024-12-31 -MaxPages 2 -MaxTasks 100 -BatchOrder window-first -PageLimit 250 -Workers 24
.\scripts\run-news-event-historical-backfill.ps1 -PoolSize 1000 -StartDate 2014-01-01 -EndDate 2018-12-31 -WindowDays 365 -MaxPages 2 -MaxTasks 10000 -BatchOrder window-first -PageLimit 250 -Workers 24
.\scripts\run-stock-news-event-intelligence.ps1 -RunKind manual -TrainingHistoryDays 3650
.\scripts\run-news-forecast-track-record.ps1
.\scripts\get-news-training-coverage.ps1