Looks like it’s happening in the get_tag_permastruct() function in wp_rewrite (called by wp_tag_cloud()). Maybe switch_blog() has no effect there?