Change theme
Help
Press space for more information.
Show links for this issue (Shortcut: i, l)
Copy issue ID
Previous Issue (Shortcut: k)
Next Issue (Shortcut: j)
Sign in to use full features.
Vote: I am impacted
Notification menu
Refresh (Shortcut: Shift+r)
Go home (Shortcut: u)
Pending code changes (auto-populated)
View issue level access limits(Press Alt + Right arrow for more information)
Request for new functionality
View staffing
Description
Currently, Dataflow jobs running on Docker containers do not leverage DNS caching, resulting in frequent DNS resolution queries to the same endpoints (e.g., Google endpoints) every second. This behavior leads to unnecessary DNS lookups, which can negatively impact performance, increase network traffic,
-Dataflow jobs, especially those running in Docker containers, repeatedly query the same DNS endpoint (such as Google DNS
servers) almost every second.
-By default, Docker containers inherit the host's /etc/resolv.conf but do not use any DNS cache, leading to repeated DNS
lookups even for the same domains or IP addresses.
-This frequent DNS resolution can degrade the overall performance of Dataflow jobs, especially at scale, as repeated network
requests may add latency and increase load on DNS servers.