This is the Yachting set and was part of the Sports and Amusements portion of the Ball. If you look closely you can see that the skirts of the women are decorated with the flag of the Royal Canadian Yacht Club.
 

The Yachting Set Toronto, 1897 Farmer Bros. Loan courtesy of the Royal Canadian Yacht Club Archives