Firebase export intraday events does not migrate to main events table

[gilreim]

Hello, 

As far as I know, the intraday table is a temporary table which eventually merges into the main events_ table. This is supposed to take place in 1-2 days. But, I have multiple previous days that are not merged to the events_ table. E.g. December 12, 13 and November 25. What can I do to resolve this and what might be the cause of this?

Thanks!

[Roderick]

Hey there, not a Firebase expert, but you're right -- Firebase intraday events should automatically migrate to the main events_ table within 1-2 days. It's concerning that your December 12th, 13th, and November 25th events haven't migrated yet.

There are a couple common reasons why this may be happening, including: 

• Export configuration errors: Incorrect settings for frequency, schema, or table configuration can prevent the migration process from working properly.
• Throttling: If your project exceeds the export quota, the migration might be delayed or paused.
• Schema mismatch: Inconsistent schema between Firebase Analytics and BigQuery can cause data migration issues.
• BigQuery export errors: Technical issues with BigQuery itself could be preventing the migration.

After checking the above (if you already,) if this issue persist, I recommend reaching out to support through your console to ensure there aren't other issues. 

[gilreim]

Hello Roderick,

Thank you for the reply.

• I did not configure anything manually. I am not sure if there are incorrect settings as everything is automatically handled via BigQuery integration in Firebase.
• We activated blaze plan (pay as you go billing) and we are paying daily. Also, we activated "streaming" option to not get throttled by 1 million events quota.
• Schema is the same (default) as every day. There are only 4 or 5 days that are not migrated to the events_ table. If there are issues with that, I would expect the other days to go unmerged as well.

I will check what you mentioned, regardless. Thank you for the response!

[Roderick]

I see you've done your due diligence! Let me know if you find anything out. I'll also share this question with our Support Team to see if anyone has ideas. 

[gilreim]

Hello Roderick,

Does the support team have any ideas? I can't find anything to fix on my end.

Thanks.

[gilreim]

Can anyone help with this issue? This issue keeps happening even more frequently now. We are paying money for this to work properly. I don't have a portion of the data from Dec 30-31 Jan 1-2-3-4. How is this even possible????