The militants told the gathering of residents of Kabal sub-division that they had made a mistake by joining the Taliban, whose leadership is "anti-Pakistan and anti-Islam."
They requested the people to forgive them for their crimes, the Daily Times newspaper reported.
The Taliban fighters appeared before the public at a gathering held at the 'hujra' or guesthouse of local defence committee chief Idress Khan in Bara Bande village.
The militants are residents of Kabal, a former Taliban stronghold, and were arrested during the operation conducted by the army in Swat last year.
This was the first time that Taliban militants appeared at a public gathering in Swat, located 160 kms from Islamabad.
The militants were later taken away to a detention centre located at an unknown place, witnesses said.
The army has asked residents of Kabal to keep an eye on suspicious elements and to inform it if any wanted terrorists are spotted.
The Taliban had set up a parallel administration in most parts of Swat valley.
This prompted the government to launch an army operation to flush out the militants from Swat and surrounding districts.
