A province is almost always an administrative division, within a country or state. The term derives from the ancient Roman provincia, which was the major territorial and administrative unit of the Roman Empire's territorial possessions outside Italy. The term is now used in many countries.
In many countries with no actual provinces, "the provinces" or "the province" means outside the capital city.