Use Apigee to securely share and monetize large data sets in BigQuery

[mistryr]

It’s no secret that thousands of organizations, from startups to large enterprises, use Google Cloud’s BigQuery as their cloud data warehouse.  Whether they are improving operations, analyzing financials, or optimizing sales, companies rely on BigQuery to glean actionable insights from petabyte scale data sets.

But what about sharing all of that valuable data and insights with partners, customers, and external developers?  Although BigQuery allows its users to run SQL queries to extract valuable data and insights, it does not have the capability to securely share & monetize data sets externally with partners and developers. 

This is where Apigee bridges the gap. By proxying BigQuery with Apigee, BigQuery data sets can be shared securely to various external and internal consumers.  Apigee can authenticate & authorize clients to provide access to the parts of the BigQuery data set they are permitted to consume.  Additionally, Apigee provides a developer portal to allow developers to sign up and consume APIs that share BigQuery data sets.  Finally, Organizations can utilize Apigee’s monetization capability to generate revenue from customers who would pay to access valuable BigQuery data.

So how would a developer set all of this up?  Here are the high level instructions:

1. Set up a BigQuery instance with the data set to be shared and monetized 
2. In Apigee, create an API Proxy that proxies BigQuery (via the Big Query API)
3. In the API Proxy, authenticate the client and query data from BigQuery
4. Add the API Proxy to an API Product and configure a Monetization Rate Plan
5. Publish the API Product to an Apigee Developer Portal

And that's it!  Now an API consumer can go to the Apigee Developer Portal to sign up, pay for, and consume the BigQuery data set. Here is a video that shows the final result.