Justin Bieber Hits Moulin Rouge in Paris

Caught in the Act

03/19/2013 at 01:30 PM EDT

Justin Bieber Hits Moulin Rouge in Paris

Emma Boukari, Justin Bieber, Teddy Jay and Cody Simpson

Courtesy of Emma Boukari

Justin Bieber's having a lot of fun in the City of Light.

The singer who arrived in Paris on Sunday stepped out with friends Cody Simpson, Teddy Jay and Emma Boukari to take in the sights including the Eiffel Tower, the Arc de l'Triomphe and the Moulin Rouge on Monday.

The 19-year-old arrived at the home of the French Can Can, wearing his glasses and a baseball hat, after the evening's first performance had begun. After running a gauntlet of umbrellas in the rain he joined family and tourmates at Paris's longest-running cabaret show.

The private party had been set up over the weekend according to spokesperson Fanny Rabasse. "It was arranged three days ago for his tour members including some of his dancers," the cabaret's PR Manager tells PEOPLE. "It was a group booking of 23. We have 900 places so it really wasn't any problem for us."

But Bieber'sown attendance, Rabasse says, was only confirmed an hour before his arrival at 9:15 p.m.

The Moulin Rouge with its distinctive windmill sails is as much a Paris landlmar! k as the Eiffel Tower or Napoleon's Tomb. First opened in Montmartre in 1889, the standard cost todayof an evening show only with a half bottle of champagne included is $135.

Bieber, who is scheduled to perform in concert in Paris on Tuesday, sat through most of the 75-minute show, but didn't stick around for the cabaret's signature finale "He didn't see the Can Can," Rabasse says. "But he did go backstage to meet the dancers, who were already in their Can Can costumes. He congratulated them on their show and thanked them."

Among those attending the Moulin Rouge with Bieber, close friend Alfredo Flores who Tweeted: "Saw some beautiful ladies at the Moulin Rouge tonight! Sad Christina, Pink, Mya & lil Kim didn't do an impromptu performance though!"

But it was all in a day's work for Bieber: "Fun night. #bucketlist #PARIS," he later Tweeted.

Peter Mikelbank