If your furnace is off, could it still leak carbon monoxide?

my detector went off. The fire dept. came and maintenance shut off the furnace. They are installing a new one tomorrow. For me or anyone else who may have this problem in the future, answer this.