# Data sets

Warm storage data sets.

- Table: `data_sets`
- Parquet: https://data.filecoindataportal.xyz/data_sets.parquet
- Source SQL: https://github.com/davidgasquez/filecoin-data-portal/blob/main/assets/main/data_sets.sql
- Page: https://filecoindataportal.xyz/datasets/data_sets
- Catalog: https://filecoindataportal.xyz/datasets.md
- Rows: ≈ 1,798 (snapshot estimate) · 25 columns
- Coverage: not date-indexed
- Raw sources: `raw.filecoin_api_data_sets`, `raw.filecoin_api_rails`, `raw.riba_eth_logs_decoded`

## Query

```sql
select *
from 'https://data.filecoindataportal.xyz/data_sets.parquet'
limit 10;
```

## Columns

| Name | Type | Description |
| --- | --- | --- |
| `data_set_id` | `BIGINT` | FWSS data set identifier. |
| `owner` | `VARCHAR` | Client address that pays for the data set. |
| `provider_id` | `BIGINT` | Service provider registry identifier. |
| `provider_address` | `VARCHAR` | Service provider address. |
| `payee` | `VARCHAR` | Payee address. |
| `pdp_rail_id` | `BIGINT` | Filecoin Pay PDP rail identifier. |
| `cache_miss_rail_id` | `BIGINT` | Filecoin Pay cache-miss rail identifier, if any. |
| `cdn_rail_id` | `BIGINT` | Filecoin Pay CDN rail identifier, if any. |
| `has_cdn` | `BOOLEAN` | Whether CDN payment rails were configured. |
| `created_block` | `BIGINT` | Creation block number. |
| `created_at` | `TIMESTAMP WITH TIME ZONE` | UTC creation timestamp. |
| `billing_started_block` | `BIGINT` | First block with a positive billing rate, if any. |
| `billing_started_at` | `TIMESTAMP WITH TIME ZONE` | UTC billing start timestamp, if any. |
| `billing_terminated_block` | `BIGINT` | Billing termination block, if any. |
| `billing_terminated_at` | `TIMESTAMP WITH TIME ZONE` | UTC billing termination timestamp, if any. |
| `settlement_end_epoch` | `BIGINT` | Settlement end epoch, if any. |
| `settlement_end_at` | `TIMESTAMP WITH TIME ZONE` | UTC settlement end timestamp, if any. |
| `source` | `VARCHAR` | Current source metadata value, from the Filecoin API. |
| `metadata` | `VARCHAR` | Current data set metadata as JSON, from the Filecoin API. |
| `with_ipfs_indexing` | `BOOLEAN` | Whether IPFS indexing is requested, from the Filecoin API. |
| `is_cdn_enabled` | `BOOLEAN` | Whether CDN is currently enabled, from the Filecoin API. |
| `is_deleted` | `BOOLEAN` | Whether the data set is currently deleted, from the Filecoin API. |
| `api_updated_at_block` | `BIGINT` | Last API indexer update block, not a verified event block. |
| `api_indexed_block` | `BIGINT` | Latest API indexer block before the snapshot. |
| `api_observed_at` | `TIMESTAMP` | UTC Filecoin API snapshot timestamp. |

## Sample

5 rows exactly as stored. Values are code spans; strings with whitespace or backslashes use JSON literals. A bare null is missing, not zero.

| `data_set_id` | `owner` | `provider_id` | `provider_address` | `payee` | `pdp_rail_id` | `cache_miss_rail_id` | `cdn_rail_id` | `has_cdn` | `created_block` | `created_at` | `billing_started_block` | `billing_started_at` | `billing_terminated_block` | `billing_terminated_at` | `settlement_end_epoch` | `settlement_end_at` | `source` | `metadata` | `with_ipfs_indexing` | `is_cdn_enabled` | `is_deleted` | `api_updated_at_block` | `api_indexed_block` | `api_observed_at` |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| `1` | `0x2127c3a31f54b81b5e9ad1e29c36c420d3d6ecc5` | `1` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `1` | null | null | `false` | `5465826` | `2025-11-04 18:33:00+00` | `5465828` | `2025-11-04 18:34:00+00` | `6059912` | `2026-05-30 01:16:00+00` | `6062261` | `2026-05-30 20:50:30+00` | null | null | `false` | `false` | `true` | `6089081` | `6499462` | `2026-10-29 16:12:05.227428` |
| `2` | `0xaf992fbc0c22bc941a232c63dc1b0c0cd572d145` | `1` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `2` | `3` | `4` | `true` | `5467575` | `2025-11-05 09:07:30+00` | `5467577` | `2025-11-05 09:08:30+00` | null | null | null | null | `filecoin-pin` | `{"source": "filecoin-pin", "withCDN": "", "withIPFSIndexing": ""}` | `true` | `true` | `false` | `5467575` | `6499462` | `2026-10-29 16:12:05.227428` |
| `3` | `0xaf992fbc0c22bc941a232c63dc1b0c0cd572d145` | `1` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `5` | null | null | `false` | `5467591` | `2025-11-05 09:15:30+00` | `5467593` | `2025-11-05 09:16:30+00` | null | null | null | null | null | null | `false` | `false` | `false` | `5467591` | `6499462` | `2026-10-29 16:12:05.227428` |
| `4` | `0xaf992fbc0c22bc941a232c63dc1b0c0cd572d145` | `1` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `6` | `7` | `8` | `true` | `5467605` | `2025-11-05 09:22:30+00` | `5467607` | `2025-11-05 09:23:30+00` | null | null | null | null | null | `{"withCDN": ""}` | `false` | `true` | `false` | `5467605` | `6499462` | `2026-10-29 16:12:05.227428` |
| `5` | `0x741c0a74b858396c966fb139db17e4ad484cc446` | `1` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `0x32c90c26bca6ed3945de9b29ba4e19d38314d618` | `9` | `10` | `11` | `true` | `5471214` | `2025-11-06 15:27:00+00` | `5471217` | `2025-11-06 15:28:30+00` | null | null | null | null | null | null | `false` | `false` | `false` | `5471224` | `6499462` | `2026-10-29 16:12:05.227428` |