This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Alternative after termination of IoTCore service using MQTT

Posted on 04-06-2023 06:03 PM
fuji1
Bronze 3
Bronze 3
Reply posted on --/--/---- --:-- AM

Hello.

I am currently sending data from an edge device to BigQuery with the following configuration.
  Edge device ➡ (MQTTS) ➡ IoTCore ➡ Pub/Sub ➡ BigQuery

However, I am looking for an alternative as IoTCore will be out of service in 2023/8.
I found this article but could not find a solution.

I have two questions.
(1) If I follow this article and build a standalone MQTT broker in Compute Engine or GKE, how does Pub/Sub connect to the MQTT broker?
(2) Are there any other ways to send data from an edge device to BigQuery using MQTT?

Thank you in advance for your help.

Solved Solved
0 3 1,910
Topic Labels
Jump to Solution
0 Likes
1 ACCEPTED SOLUTION

Posted on --/--/---- --:-- AM
pthiagar
Staff
Reply posted on --/--/---- --:-- AM

Hello @fuji1 

There's a GCP provided Dataflow streaming pipeline template that reads MQTT topic messages and writes them to Pub/Sub. See documentation  here: https://cloud.google.com/dataflow/docs/guides/templates/provided/mqtt-to-pubsub

Alternatively, you could define your own batch or streaming data pipeline using Apache Beam and run the pipeline in Dataflow.

Hope this helps.

 

View solution in original post

Jump to Solution
3 REPLIES 3
Top Labels in this Space