Racism?

Today's Sunday and I spent the morning doing laundry as always, before heading to MT, the capital of this prefecture, to meet 2 other ALTs for lunch and karaoke.

All was fine till I returned. As it was still early, I thought I would explore the public gymnasium near KTS. Anyway I arrived at 5pm and then tried to ask at the reception.

Me: -japanese- Excuse me, but may I ask how do I go about using the gymnasium please?
Ojisan-A: -japanese- What do you mean? ... -he appears lost-
Me: -japanese- Sorry I don't understand you...
Ojisan-A: -japanese- Would you like to use the soccer pitch, the basketball court...
Me: -japanese- I will like to use the training room..?
Ojisan-A: -japanese- It only opens from 6pm.
Me: -japanese- What time does it close?
Ojisan-B: -japanese- It only opens from 6pm.
Me: -japanese- What time does it close?
Ojisan-A doesn't understand what exactly I am asking for (because I am unsure what on earth the Japanese call a gym - gymnasium? weights room? training room?)
Ojisan-A is flustered and calls Ojisan-B
Ojisan-B: -english- Can you speak English?
Me: -english- Yes I can. This is my first time here and I will like to use the gym.
Ojisan-B: -english- The gym opens from 6pm to 10pm on Sundays.
Me: -english- What about the rest of the week?
Ojisan-B: -english- 9am to 10pm for all days except Monday.
Me: -english- But today is Sunday.
Ojisan-B: -english- Today it opens from 6pm to 10pm.
Me: -english- How much does it cost to use the gym?
Ojisan-B: -english- 210 yen.
Ojisan-B: -english- Are you a Chinese?
Me: -english- Yes.
Ojisan-B suddenly walks away and I definitely looked confused, standing there for a moment before realising the sign in front of the window has the time schedule and all other information. After seeing he is back doing his work behind his desk and obviously ignoring me, I left in disgust.

I heard a couple of weeks ago that some Japanese do not like Chinese, which I do see a couple of mainland Chinese in my town. However this is the first time I experienced such a treatment in Japan. Usually, when I look flustered, the Japanese person will also look sympathetic. But not Ojisan-B.