If a job candidate told me their previous team had a closed-culture and was unappreciative of their talents I would think it was the candidate who was difficult and thought too highly of himself.

I would simply stick the lines of "The work they had me doing wasn't where my strengths really were. I think there was some miscommunication during the hiring process as to what the job really entailed". All of which is true in OP's case - it wasn't communicated to him how incompatible he would be with his team and he's not going to perform his best work there. This method doesn't place blame on anyone (important) and doesn't make you sound difficult or overly particular.