Datasets / data_sets

Data sets

Warm storage data sets.

Shape

Table
data_sets
Rows ≈
1,798 · 25 columns · local snapshot
Grain
Key not declared
Observed, UTC
Not date-indexed · view built 2026-10-29
Raw sources
raw.filecoin_api_data_sets, raw.filecoin_api_rails, raw.riba_eth_logs_decoded · raw assets

Query

DuckDB, reads the published file
select *
from 'https://data.filecoindataportal.xyz/data_sets.parquet'
limit 10;

The published file is rebuilt daily; counts and sample here come from the local snapshot built 2026-10-29.

Columns

data_sets column definitions
NameTypeDescription
data_set_idBIGINTFWSS data set identifier.
ownerVARCHARClient address that pays for the data set.
provider_idBIGINTService provider registry identifier.
provider_addressVARCHARService provider address.
payeeVARCHARPayee address.
pdp_rail_idBIGINTFilecoin Pay PDP rail identifier.
cache_miss_rail_idBIGINTFilecoin Pay cache-miss rail identifier, if any.
cdn_rail_idBIGINTFilecoin Pay CDN rail identifier, if any.
has_cdnBOOLEANWhether CDN payment rails were configured.
created_blockBIGINTCreation block number.
created_atTIMESTAMP WITH TIME ZONEUTC creation timestamp.
billing_started_blockBIGINTFirst block with a positive billing rate, if any.
billing_started_atTIMESTAMP WITH TIME ZONEUTC billing start timestamp, if any.
billing_terminated_blockBIGINTBilling termination block, if any.
billing_terminated_atTIMESTAMP WITH TIME ZONEUTC billing termination timestamp, if any.
settlement_end_epochBIGINTSettlement end epoch, if any.
settlement_end_atTIMESTAMP WITH TIME ZONEUTC settlement end timestamp, if any.
sourceVARCHARCurrent source metadata value, from the Filecoin API.
metadataVARCHARCurrent data set metadata as JSON, from the Filecoin API.
with_ipfs_indexingBOOLEANWhether IPFS indexing is requested, from the Filecoin API.
is_cdn_enabledBOOLEANWhether CDN is currently enabled, from the Filecoin API.
is_deletedBOOLEANWhether the data set is currently deleted, from the Filecoin API.
api_updated_at_blockBIGINTLast API indexer update block, not a verified event block.
api_indexed_blockBIGINTLatest API indexer block before the snapshot.
api_observed_atTIMESTAMPUTC Filecoin API snapshot timestamp.

Sample

5 rows from the local snapshot, exactly as stored.

data_sets sample rows
data_set_idownerprovider_idprovider_addresspayeepdp_rail_idcache_miss_rail_idcdn_rail_idhas_cdncreated_blockcreated_atbilling_started_blockbilling_started_atbilling_terminated_blockbilling_terminated_atsettlement_end_epochsettlement_end_atsourcemetadatawith_ipfs_indexingis_cdn_enabledis_deletedapi_updated_at_blockapi_indexed_blockapi_observed_at
10x2127c3a31f54b81b5e9ad1e29c36c420d3d6ecc510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d6181nullnullfalse54658262025-11-04 18:33:00+0054658282025-11-04 18:34:00+0060599122026-05-30 01:16:00+0060622612026-05-30 20:50:30+00nullnullfalsefalsetrue608908164994622026-10-29 16:12:05.227428
20xaf992fbc0c22bc941a232c63dc1b0c0cd572d14510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d618234true54675752025-11-05 09:07:30+0054675772025-11-05 09:08:30+00nullnullnullnullfilecoin-pin{"source": "filecoin-pin", "withCDN": "", "withIPFSIndexing": ""}truetruefalse546757564994622026-10-29 16:12:05.227428
30xaf992fbc0c22bc941a232c63dc1b0c0cd572d14510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d6185nullnullfalse54675912025-11-05 09:15:30+0054675932025-11-05 09:16:30+00nullnullnullnullnullnullfalsefalsefalse546759164994622026-10-29 16:12:05.227428
40xaf992fbc0c22bc941a232c63dc1b0c0cd572d14510x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d618678true54676052025-11-05 09:22:30+0054676072025-11-05 09:23:30+00nullnullnullnullnull{"withCDN": ""}falsetruefalse546760564994622026-10-29 16:12:05.227428
50x741c0a74b858396c966fb139db17e4ad484cc44610x32c90c26bca6ed3945de9b29ba4e19d38314d6180x32c90c26bca6ed3945de9b29ba4e19d38314d61891011true54712142025-11-06 15:27:00+0054712172025-11-06 15:28:30+00nullnullnullnullnullnullfalsefalsefalse547122464994622026-10-29 16:12:05.227428