High Speed Rail in downtown Madison, are you crazy?

I've heard rumors that Madison might be getting high speed rail and that some people are advocating that the high speed train stop in downtown Madison. I believe that the high speed train should have a stop at the airport. To me, this makes much more sense both practically and economically.
-Connecting our high speed rail to the airport is crucial to have an integrated transportation infrastructure, and the airport already has the basic parking set up and enough room to accommodate a decent station.
-Another problem with having the high speed rail stop downtown is the amount of time needed for the train to get downtown. This would increase train times dramatically, not to mention the problem of building high speed track in downtown Madison.

I believe the best solution is to have the high speed rail stop only at the airport and be connected to a commuter train that runs from Middleton (or even Cross Plains or further out) to the airport that stops in downtown Madison.