Daily provider quality

Daily Dealbot probe outcomes and onchain PDP proving per service provider. Probes are not client traffic. Check types with no observations for a provider and date are NULL.

Shape

Table
daily_provider_quality
Rows ≈
6,753 · 39 columns · local snapshot
Grain
Key not declared
Observed, UTC
2025-11-04 → 2026-11-17 first and last day; days may be missing
Raw sources
raw.filecoin_api_data_sets, raw.filecoin_api_rails, raw.probelab_pull_checks, raw.probelab_retrieval_checks, raw.probelab_sampled_retrieval_checks, raw.probelab_storage_checks, raw.riba_eth_logs, raw.riba_eth_logs_decoded · raw assets

Query

DuckDB, reads the published file
select *
from 'https://data.filecoindataportal.xyz/daily_provider_quality.parquet'
limit 10;

The published file is rebuilt daily; counts and sample here come from the local snapshot built 2026-11-18.

Columns

daily_provider_quality column definitions
NameTypeDescription
dateDATEUTC date.
provider_idUBIGINTService provider registry identifier; null when a Dealbot check did not record it.
storage_checksBIGINTData storage checks that finished as created or failed.
storage_successesBIGINTData storage checks that created the deal.
storage_median_upload_msDOUBLEMedian upload time to the provider of created deals, in milliseconds.
storage_median_confirmation_msDOUBLEMedian time from piece added to piece confirmed onchain of created deals, in milliseconds.
retrieval_checksBIGINTIPFS retrievals of Dealbot's own deals.
retrieval_successesBIGINTSuccessful IPFS retrievals of Dealbot's own deals.
retrieval_median_ttfb_msDOUBLEMedian time to first byte of successful retrievals, in milliseconds.
retrieval_p95_ttfb_msDOUBLE95th percentile time to first byte of successful retrievals, in milliseconds.
retrieval_median_bytes_per_secondDOUBLEMedian download rate of successful retrievals, in bytes per second.
pull_checksBIGINTPull-to-park checks.
pull_successesBIGINTSuccessful pull-to-park checks.
pull_median_completion_msDOUBLEMedian time from pull request to completion of successful pulls, in milliseconds.
pull_p95_completion_msDOUBLE95th percentile time from pull request to completion of successful pulls, in milliseconds.
pull_median_bytes_per_secondDOUBLEMedian piece bytes over total completion time of successful pulls, in bytes per second.
sampled_retrieval_checksBIGINTAttempted piece retrievals of sampled non-Dealbot pieces.
sampled_retrieval_successesBIGINTSampled piece retrievals returning HTTP 2xx with bytes matching the piece CID.
sampled_retrieval_skippedBIGINTSampled retrieval checks skipped because no candidate piece was found.
sampled_retrieval_median_ttfb_msDOUBLEMedian time to first byte of successful sampled retrievals, in milliseconds.
sampled_retrieval_p95_ttfb_msDOUBLE95th percentile time to first byte of successful sampled retrievals, in milliseconds.
sampled_retrieval_median_bytes_per_secondDOUBLEMedian download rate of successful sampled retrievals, in bytes per second.
sampled_car_checksBIGINTSampled-piece checks that attempted CAR parsing. Skips are excluded; malformed CAR data is not a provider-fault measure.
sampled_car_successesBIGINTSampled-piece checks whose fetched bytes parsed as a CAR.
sampled_ipni_checksBIGINTSampled-piece checks that attempted IPNI verification. Skips are excluded.
sampled_ipni_successesBIGINTSampled IPNI lookups resolving every CID to the provider.
sampled_ipni_median_verify_msDOUBLEMedian IPNI verification time of successful sampled IPNI lookups, in milliseconds.
sampled_block_fetch_checksBIGINTSampled-piece checks that attempted gateway block fetches. Skips are excluded.
sampled_block_fetch_successesBIGINTSampled-piece checks where every fetched block matched its CID.
proving_proofsHUGEINTAccepted onchain PDP proofs of FWSS data sets. Null when onchain logs through the date are not fully decoded or the provider has no proving data set.
proving_periods_closedHUGEINTProving periods closed onchain on the date, faulted or proven. Null under the same conditions as proving_proofs.
proving_periods_faultedHUGEINTProving periods recorded as faulted when closed on the date; missed periods remain uncounted until closure. Null under the same conditions as proving_proofs.
storage_success_rateDOUBLEstorage_successes over storage_checks.
retrieval_success_rateDOUBLEretrieval_successes over retrieval_checks.
pull_success_rateDOUBLEpull_successes over pull_checks.
sampled_retrieval_success_rateDOUBLEsampled_retrieval_successes over sampled_retrieval_checks.
sampled_ipni_success_rateDOUBLEsampled_ipni_successes over sampled_ipni_checks.
sampled_block_fetch_success_rateDOUBLEsampled_block_fetch_successes over sampled_block_fetch_checks.
proving_fault_rateDOUBLEproving_periods_faulted over proving_periods_closed.

Sample

5 rows from the local snapshot, latest first, exactly as stored.

daily_provider_quality sample rows
dateprovider_idstorage_checksstorage_successesstorage_median_upload_msstorage_median_confirmation_msretrieval_checksretrieval_successesretrieval_median_ttfb_msretrieval_p95_ttfb_msretrieval_median_bytes_per_secondpull_checkspull_successespull_median_completion_mspull_p95_completion_mspull_median_bytes_per_secondsampled_retrieval_checkssampled_retrieval_successessampled_retrieval_skippedsampled_retrieval_median_ttfb_mssampled_retrieval_p95_ttfb_mssampled_retrieval_median_bytes_per_secondsampled_car_checkssampled_car_successessampled_ipni_checkssampled_ipni_successessampled_ipni_median_verify_mssampled_block_fetch_checkssampled_block_fetch_successesproving_proofsproving_periods_closedproving_periods_faultedstorage_success_rateretrieval_success_ratepull_success_ratesampled_retrieval_success_ratesampled_ipni_success_ratesampled_block_fetch_success_rateproving_fault_rate
2026-11-171969411261.55342414314290.51853539668.961588605242466699644.2999999999971572314.548470269402.41454723.3175994605444444422271444420320300.97916666666666660.99300699300699310.97916666666666660.954545454545454610
2026-11-1729695917857764142142677.51740.29999999999932080816.3623457802241810677201791.659850564848013612300.953664828.4507426107383838381664.53837202000.989583333333333410.75110.97368421052631580
2026-11-173nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull000nullnullnullnullnullnullnull
2026-11-17596966589.556748119118505574.64999999999971570980.155098612424791412296.0999999999971325039.5484801065.51296.751744681.92415969334747474720404747161165410.991596638655462211110.024242424242424242
2026-11-176nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull000nullnullnullnullnullnullnull