Group-living animals gain fitness benefits from intergroup aggression, but also incur costs. Advertisement behaviors, such as long-distance calls and scent marking, help animals avoid disadvantageous, or less rewarding, fights. However, it remains unclear how species that lack advertisement behaviors respond to auditory information from other groups. We hypothesized that such species use auditory information prior to visual contact with the opponent group to determine its relative resource holding potential. Here, we aimed to identify the behavioral responses of Japanese macaques to simulated intergroup encounters. We conducted a vocal playback experiment and behavioral observations of 11 adult males and females from two groups intermittently from October 2015 to June 2017. In response to vocalizations of other groups, the macaques stopped feeding, decreased contact calling, and increased visual scanning, which could enable them to make timely and accurate decisions as to whether to fight or flee. The spatial cohesion of the group did not change. These results partly support our hypothesis and suggest that the onset of increased vigilance to opponents is prior to visual contact with them. The present study highlights the importance of investigating early phases of intergroup encounters in species lacking advertisement behaviors to obtain new insights on intergroup conflicts in animals.