The government has decided to take an initiative to deport around 11,000 foreigners staying in Bangladesh without valid documents over the years.