The textures were loading fine in Unity but in VRchat they were pink, to fix this I set the shader from Diffuse to Unlit Toon.