The only one I know of is at the North York Civic Center (Sheppard and Yonge St). Call them for hours since the online stuff isn’t always accurate:
http://www.swimmersguide.com/query/Detail.cfm?PoolID=5483
If you’re ever here in the summer, there’s a nice 50m pool in the beaches too.