With Paris the Tour's traditional host for its finale on the Champs-Élysées, and with millions of spectators lining the length of the Tour route freely every year, Rogers says that the threat of attacks could kill the essence of the Tour and other bike races as a spectacle.
"You could only imagine the expense for the organisers to barrier the whole circuit for hundreds of kilometres, I don't think that's a feasible thing to do," Rogers told the Sydney Morning Herald.
The German May Day race, Eschborn-Frankfurt was cancelled earlier this year because of a potential terrorist threat, as bomb-making materials were found in a house near the route, along with a fire-arm and ammunition.
"It's been in the back of my mind," Rogers continued. "Events such as the Tour [de France], a big international event where the whole world is watching."
"A lot of riders do think about it because we pass a lot of people by the side of the road and it's quite easy for a potential attack.
"I hope the authorities are doing work in the background making sure the course is clear, but it's certainly becoming an issue especially [after] this year in May one of the races in Germany was cancelled because authorities picked up on a potential attack.
Rogers, a former world time trial champion and three-time Grand Tour stage winner, also confirmed that he would be bowing out of professional cycling at the end of the 2016 season after 16 years in the sport.
The 35-year-old will likely ride in support of Tinkoff teammate Alberto Contador at the Tour de France next year, as the Spaniard too looks to take his leave from the sport at the end of season.
"I think we have to take it step by step and we all have to understand that those possibilities are very difficult in cycling and it would absolutely kill the sport."
"We have quite a beautiful view from the peloton where we see so many smiling faces and that's a huge motivating factor for the riders as well."
Mick Rogers (Tinkoff-Saxo) says the potential for a terrorist attack at the Tour de France has "been in the back of my mind" for some time because of the vulnerable nature of the sport.
The Australian's comments came in the wake of the November 13 attacks in Paris which killed 129 people, 89 of whom were attending a rock concert at the Bataclan theatre in the 11th arrondissement of the city.
Several bombs were also detonated outside the Stade de France, where the French national team were playing Germany in an international friendly at the time.
"I think it's time, 16 years that will give me and I'm very proud of what I've done, but that's enough, that's enough," Rogers told Fairfax Media.
"It's physically been very demanding and my girls are growing up quickly so it's time also to be a father and think about something else."
Tweets of the week: Rohan Dennis, Philippe Gilbert and wait a minute, is that G?
The latest instalment of our weekly social media round-up, featuring Geraint Thomas, Philippe Gilbert, and Rohan Dennis
By Jonny Long •
Custom Kask Utopia helmets designed by MotoGP artist Aldo Drudi to be presented to Giro stage winners
Special trophies unveiled, while Kask’s sister brand Koo launches Giro edition eyewear
By Simon Smythe •
Heart problem forces Michael Rogers to miss Tour Down Under
Tinkoff-Saxo's Michael Rogers is forced to scale back his training and stop racing after a UCI heart check found a problem
By Gregor Brown •
Tinkoff-Saxo riders show their scars after TTT crash
Rogers and Valgren went down heavily during the race and ended the team's chances of a competitive time
By Jack Elton-Walters •
Tinkoff-Saxo's team time trial crash puts paid to good performance (video)
Tinkoff-Saxo's Peter Sagan escapes injury as Michael Valgren and Michael Rogers hit the deck during Sunday's World Championships team time trial
By Nigel Wynn •
Michael Rogers free to return to competition after UCI lifts provisional suspension
UCI warns teams and athletes to avoid eating meat in countries where clenbuterol is well documented
By Sophie Smith •