Swift trust me is a better drive. My sis in law has an auto Swift, a Honda Jazz and I have test driven the Latio basic model. Between the three I strongly dislike the Jazz because of the back breaking suspension of the top variant but the lowest end one surprisingly isn't that bad. But it's not for me.
Latio was meh. Not CVT but still quite a dull car looks wise, driving dynamis, etc.
Swift wasn't that great in terms of acceleration but possibly because my sis-in-law drives slow and probably ruined the run-in of the car but cornering stability is good and I've dismantled the interior of the car too. Everything is clips! Pros and cons to that. Sooner or later the panels will have gaps due to age, wear and tear, etc but imagine how easy it would be strip everything down.
Between the 3 I like the Swift but Latio has more rear legroom. But if it's not meant to be a people carrier and just a point A to point B car, the Swift is a better car and is more economical supposedly. This I never got to test but my SIL says her Swift gets between 12 to 14km/L which is Myvi territory.