Smell is an outlier. The way smell works is that the brain essentially sent out a little tentacle into the world, those nerve fibres are the only contact between the central nervous system and the external world. This is the point at which there is no barrier between the brain and the outside world.