I have absolutely time travelled, and honestly mostly did it so villagers would spread rumours about me being a time traveller because I thought that was cute. In New Leaf I think I specifically only went backwards to play days I hadn't been able to for whatever reason and then only went forward and then didn't play until real time matched up with the game's time (so I would time travel from Monday to Tuesday and then Wednesday and then Thursday, and then turn the game off until it really was Thursday; or I wouldn't play for a week, so I would time travel back to the day I'd stopped playing and then time travel forward to the day it is) because that one had a high risk of losing villagers, but I think New Horizons had less risk and I was more loose about it
I know ash also time travels a lot