"During previous Olympics, several federal agencies have supported security for U.S. diplomats, including the investigative component of ICE called Homeland Security Investigations, the sources said."
Idk how it works in detail. I guess countries usually allow diplomats to go around with their own security, whichever the fuck organization the security comes from.