Matt Shultz of Cage the Elephant performs during the Wonderfront Music & Arts Festival at Seaport Village on November 20, 2022 in San Diego, California
Tim Mosenfelder/Getty Matt Schultz
Cage the Elephant singer Matt Schultz was arrested Thursday in New York City and charged with criminal gun possession, the New York City Police Department confirmed to PEOPLE.
An employee at the Bowery Hotel on Manhattan’s Lower East Side called police after allegedly seeing 39-year-old Schultz carry a handgun into a downstairs public restroom on Wednesday night, according to the Chron.
Police say they responded a day later and knocked on Schultz’s door. He reportedly admitted to police that he possessed two .45 caliber guns, but when asked by police if he still had the guns, he replied that he didn’t know, according to the publication.
The NYPD says he was then arrested and taken to the 9th Precinct precinct.
A judge issued a search warrant for police to enter his room, where officers found two loaded guns, a Sig Sauer and a Smith & Wesson, according to the Chron.
TIED TOGETHER: Cage the Elephant wins the Grammy for Best Rock Album
There are conflicting media reports as to whether or not Schultz held a gun license for the guns. The Chron reported that Schultz didn’t have one, while ET Canada claims he did.
Schultz’s reps have not yet responded to PEOPLE’s request for comment.
The “Ain’t No Rest for the Wicked” singer had reportedly briefly left the 9th Ward Ward House on Friday to pick up medication from Bellevue Hospital before returning a few hours later.
Schultz had no criminal record prior to his arrest on Thursday.
Rock band Cage the Elephant formed in Bowling Green, Kentucky in 2006. Schultz previously worked at a sandwich bar and as a plumber before joining the band.
Don’t miss a story – subscribe The free daily newsletter from PEOPLE to keep up to date with the best that PEOPLE has to offer, from juicy celebrity news to compelling human-interest stories.
The band enjoyed commercial and critical success when their sophomore album Thank You Happy Birthday debuted at number 2 on the Billboard 200 and their 2015 studio album Tell Me I’m Pretty received a Grammy for Best Rock Album. They also won another Grammy for Best Rock Album for their 2019 album Social Cues.
The band is scheduled to perform in Toronto, Canada on August 2nd and at Festiven in Quebec, Canada two days later. It’s not yet known if Schultz’s arrest will affect those tour dates.