A web server sends click events to a Pub/Sub topic as messages. The web server includes an eventTimestamp attribute in the messages, which is the time when the click occurred. You have a Dataflow streaming job that reads from this Pub/Sub topic through a subscription, applies some transformations, and writes the result to another Pub/Sub topic for use by the advertising department. The advertising department needs to receive each message within 30 seconds of the corresponding click occurrence, but they report receiving the messages late. Your Dataflow job's system lag is about 5 seconds, and the data freshness is about 40 seconds. Inspecting a few messages show no more than 1 second lag between their eventTimestamp and publishTime. What is the problem and what should you do?
e70ea9e
Highly Voted 11 months agoraaad
Highly Voted 10 months, 3 weeks agodatapassionate
10 months, 2 weeks agoRenePetersen
9 months, 2 weeks ago4a8ffd7
Most Recent 2 months, 2 weeks agoJyoGCP
9 months, 1 week agoMatt_108
10 months, 2 weeks agoAlex3551
10 months, 3 weeks ago