Time Course of Odor Categorization Processing

The Impact of Odor Category Similarity on Multimedia Experience

Although we have multiple senses, multimedia mainly targets vision and olfaction. To expand the senses impacted by multimedia, olfactory stimulation has been used to enhance the sense of reality. Odors are primarily matched with objects in scenes. However, it is impractical to select all odors that match all objects in a scene and offer them to viewers. As an alternative, offering a single odor in a category as representative of other odors belonging to that category has been suggested. However, it is unclear whether viewers' responses to videos with multiple odors (e.g., rose, lavender, and lily) from a category (e.g., flowers) are comparable. Therefore, we studied whether odors belonging to a given category could be similar in behavioral congruency and in the five frequency bands (delta, theta, alpha, beta, and gamma) of electroencephalogram (EEG) data collected while viewers watched videos. We conducted questionnaires and EEG experiments to understand the effects of similar odors belonging to categories. Our results showed that similar odors in a specific odor category were more congruent with videos than those in different odor categories. In our EEG data, the delta and theta bands were mainly clustered when odors were offered to viewers in similar categories. The theta band is known to be primarily related to the neural signals of odor information. Our studies showed that choosing odors based on odor categories in multimedia can be feasible.

Spatiotemporal dynamics of odor representations in the human brain revealed by EEG decoding

To elucidate when and where in the brain different aspects of odor perception emerge, we decoded odors from an electroencephalogram and associated the results with perception and source activities. The odor information was decoded 100 ms after odor onset at the earliest, with its signal sources estimated in and around the olfactory areas. The neural representation of odor unpleasantness emerged 300 ms after odor onset, followed by pleasantness and perceived quality at 500 ms. During this time, brain regions representing odor information spread rapidly from the olfactory areas to regions associated with emotional, semantic, and memory processing. The results suggested that odor perception emerges through computations in these areas, with different perceptual aspects having different spatiotemporal dynamics.

How the human brain translates olfactory inputs into diverse perceptions, from pleasurable floral smells to sickening smells of decay, is one of the fundamental questions in olfaction. To examine how different aspects of olfactory perception emerge in space and time in the human brain, we performed time-resolved multivariate pattern analysis of scalp-recorded electroencephalogram responses to 10 perceptually diverse odors and associated the resulting decoding accuracies with perception and source activities. Mean decoding accuracies of odors exceeded the chance level 100 ms after odor onset and reached maxima at 350 ms. The result suggests that the neural representations of individual odors were maximally separated at 350 ms. Perceptual representations emerged following the decoding peak: unipolar unpleasantness (neutral to unpleasant) from 300 ms, and pleasantness (neutral to pleasant) and perceptual quality (applicability to verbal descriptors such as “fruity” or “flowery”) from 500 ms after odor onset, with all these perceptual representations reaching their maxima after 600 ms. A source estimation showed that the areas representing the odor information, estimated based on the decoding accuracies, were localized in and around the primary and secondary olfactory areas at 100 to 350 ms after odor onset. Odor representations then expanded into larger areas associated with emotional, semantic, and memory processing, with the activities of these later areas being significantly associated with perception. These results suggest that initial odor information coded in the olfactory areas (<350 ms) evolves into their perceptual realizations (300 to >600 ms) through computations in widely distributed cortical regions, with different perceptual aspects having different spatiotemporal dynamics.