The ban on public and private transport on the election day is taking a heavy toll on the public, former chief election commissioner ATM Shamsul Huda said today.