If youre peeved about specifically indians or indonesians that is racism even if its not overt racism, you chose the right word. I would know since I had that same feeling. Its good that you can acknowledge it and its irrationality. recognising it is a first step to do let go of that sentiment.
Also "im sorry I offended you" is not the best thing to say in an apology, just saying.