"A search is currently underway in the premises of the bank, led by Attorney General Olivier Jornot and the prosecutor Yves Bertossa," Geneva's prosecutor said in a statement.
HSBC, Europe's biggest bank, apologised to customers and investors on Sunday for past practices at its Swiss private bank following allegations that it helped hundreds of clients dodge taxes.
The prosecutor said its investigation was into HSBC Private Bank (Suisse) and could extend to individuals.
Spokesmen for HSBC in Geneva and London declined to comment.
The bank has said compliance and controls at its Swiss private bank in the period up to 2007 fell short of requirements. But it said the business had been transformed in recent years, adding that many people alleged to have been customers had long since left and that some were never clients.
The disclosures have sparked a political row in Britain over practices at HSBC and whether tax authorities had done enough to pursue possible wrongdoers. Some other tax authorities are looking at the allegations to assess if their nationals evaded tax.