Data sets

Warm storage data sets.

Shape

Table
data_sets
Rows ≈
1,937 · 27 columns · local snapshot
Grain
Key not declared
Observed, UTC
Not date-indexed · view built 2026-11-17
Raw sources
raw.filecoin_api_data_sets, raw.filecoin_api_rails, raw.riba_eth_logs, raw.riba_eth_logs_decoded · raw assets

Query

DuckDB, reads the published file
select *
from 'https://data.filecoindataportal.xyz/data_sets.parquet'
limit 10;

The published file is rebuilt daily; counts and sample here come from the local snapshot built 2026-11-17.

Columns

data_sets column definitions
NameTypeDescription
data_set_idBIGINTFWSS data set identifier.
ownerVARCHARClient address that pays for the data set.
provider_idBIGINTService provider registry identifier.
provider_addressVARCHARService provider address.
payeeVARCHARPayee address.
pdp_rail_idBIGINTFilecoin Pay PDP rail identifier.
cache_miss_rail_idBIGINTFilecoin Pay cache-miss rail identifier, if any.
cdn_rail_idBIGINTFilecoin Pay CDN rail identifier, if any.
has_cdnBOOLEANWhether CDN payment rails were configured.
created_blockBIGINTCreation block number.
created_atTIMESTAMP WITH TIME ZONEUTC creation timestamp.
billing_started_blockBIGINTFirst block with a positive billing rate, if any.
billing_started_atTIMESTAMP WITH TIME ZONEUTC billing start timestamp, if any.
billing_terminated_blockBIGINTBilling termination block, if any.
billing_terminated_atTIMESTAMP WITH TIME ZONEUTC billing termination timestamp, if any.
settlement_end_epochBIGINTSettlement end epoch, if any.
settlement_end_atTIMESTAMP WITH TIME ZONEUTC settlement end timestamp, if any.
sourceVARCHARCurrent source metadata value, from the Filecoin API.
metadataVARCHARCurrent data set metadata as JSON, from the Filecoin API.
with_ipfs_indexingBOOLEANWhether IPFS indexing is requested, from the Filecoin API.
is_cdn_enabledBOOLEANWhether CDN is currently enabled, from the Filecoin API.
is_deletedBOOLEANWhether the data set is currently deleted, from the Filecoin API.
api_updated_at_blockBIGINTLast API indexer update block, not a verified event block.
api_indexed_blockBIGINTLatest API indexer block before the snapshot.
api_observed_atTIMESTAMPUTC Filecoin API snapshot timestamp.
storage_historySTRUCT(date DATE, pieces BIGINT, bytes BIGINT, added BIGINT, removed BIGINT)[]Sparse end-of-day stored pieces and bytes plus added and removed byte flows, ordered by date.
storage_provider_attribution_safeBOOLEANWhether creation-time providers can safely receive historical storage attribution globally.

Sample

5 rows from the local snapshot, exactly as stored.

data_sets sample rows
data_set_idownerprovider_idprovider_addresspayeepdp_rail_idcache_miss_rail_idcdn_rail_idhas_cdncreated_blockcreated_atbilling_started_blockbilling_started_atbilling_terminated_blockbilling_terminated_atsettlement_end_epochsettlement_end_atsourcemetadatawith_ipfs_indexingis_cdn_enabledis_deletedapi_updated_at_blockapi_indexed_blockapi_observed_atstorage_historystorage_provider_attribution_safe
10x2127c3a31f54b81b5e9ad1e29c36c420d3d6ecc510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d6181nullnullfalse54658262025-11-04 18:33:00+0054658282025-11-04 18:34:00+0060599122026-05-30 01:16:00+0060622612026-05-30 20:50:30+00nullnullfalsefalsetrue608908165549352026-11-17 22:28:35.040444[{"date":"2025-11-04","pieces":"1","bytes":"1049600","added":"1049600","removed":"0"},{"date":"2025-11-16","pieces":"2","bytes":"1074676","added":"25076","removed":"0"},{"date":"2026-06-09","pieces":"0","bytes":"0","added":"0","removed":"0"}]true
20xaf992fbc0c22bc941a232c63dc1b0c0cd572d14510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d618234true54675752025-11-05 09:07:30+0054675772025-11-05 09:08:30+00nullnullnullnullfilecoin-pin{"source": "filecoin-pin", "withCDN": "", "withIPFSIndexing": ""}truetruefalse546757565549352026-11-17 22:28:35.040444[{"date":"2025-11-05","pieces":"1","bytes":"199983251","added":"199983251","removed":"0"},{"date":"2026-03-27","pieces":"4","bytes":"204823105","added":"4839854","removed":"0"}]true
30xaf992fbc0c22bc941a232c63dc1b0c0cd572d14510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d6185nullnullfalse54675912025-11-05 09:15:30+0054675932025-11-05 09:16:30+00nullnullnullnullnullnullfalsefalsefalse546759165549352026-11-17 22:28:35.040444[{"date":"2025-11-05","pieces":"1","bytes":"1167428","added":"1167428","removed":"0"}]true
40xaf992fbc0c22bc941a232c63dc1b0c0cd572d14510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d618678true54676052025-11-05 09:22:30+0054676072025-11-05 09:23:30+00nullnullnullnullnull{"withCDN": ""}falsetruefalse546760565549352026-11-17 22:28:35.040444[{"date":"2025-11-05","pieces":"1","bytes":"1167428","added":"1167428","removed":"0"}]true
50x741c0a74b858396c966fb139db17e4ad484cc44610x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d61891011true54712142025-11-06 15:27:00+0054712172025-11-06 15:28:30+00nullnullnullnullnullnullfalsefalsefalse547122465549352026-11-17 22:28:35.040444[{"date":"2025-11-06","pieces":"1","bytes":"727343","added":"727343","removed":"0"}]true