Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Big Query: Partitioning public data set (chicago taxi trips) returns only data for one month

I have already posted the same question on stack overflow: stack overflow question

 

CREATE OR REPLACE TABLE <TABLE>
 PARTITION BY 
     DATE(trip_start_timestamp)
 AS (
     SELECT
       trip_start_timestamp, trip_seconds
     FROM
      `bigquery-public-data.chicago_taxi_trips.taxi_trips`
 );

 

 

After the creation of the table, I checked the results and there are no partitions before May 2022.

I have tested this with a client library as well (Python), with different CAST by date or timestamp before the load, with different qualifying filters (WHERE clause). No dates before May are picked up after the creation of the partition table.

Is there something I am missing that is so obvious that does not return the expected results?

The expected output should be a partitioned table with all the dates, no just dates or timestamps between May and June 2022.

 

0 1 610
1 REPLY 1

RC1
Bronze 4
Bronze 4

@rags2riches-pro can you plz send the screenshot of the table details page? Table details page does include the number of partitions created