For real though, why did Japanese end up with "pudding" for what I assume is mostly known as either flan or caramel custard?

Portuguese has pudim, so that might be the case? There are a lot of Portuguese loan words in Japanese.