Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B Receptors

*Berend Olivier and Jocelien D.A. Olivier*

## **Abstract**

Distinct brain mechanisms for male aggressive and sexual behavior are present in mammalian species, including man. However, recent evidence suggests a strong connection and even overlap in the central nervous system (CNS) circuitry involved in aggressive and sexual behavior. The serotonergic system in the CNS is strongly involved in male aggressive and sexual behavior. In particular, 5-HT1A and 5-HT1B receptors seem to play a critical role in the modulation of these behaviors. The present chapter focuses on the effects of 5-HT1A- and 5-HT1B-receptor ligands in male rodent aggression and sexual behavior. Results indicate that 5-HT1Bheteroreceptors play a critical role in the modulation of male offensive behavior, although a definite role of 5-HT1A-auto- or heteroreceptors cannot be ruled out. 5- HT1A receptors are clearly involved in male sexual behavior, although it has to be yet unraveled whether 5-HT1A-auto- or heteroreceptors are important. Although several key nodes in the complex circuitry of aggression and sexual behavior are known, in particular in the medial hypothalamus, a clear link or connection to these critical structures and the serotonergic key receptors is yet to be determined. This information is urgently needed to detect and develop new selective anti-aggressive (serenic) and pro-sexual drugs for human applications.

**Keywords:** aggression, sexual behavior, serotonin, 5-HT1A receptor, 5-HT1B receptor, serenics, neural circuit

## **1. Introduction**

Early studies into the role of various brain structures in aggression focused merely on the hypothalamus already starting in the 1920s by Hess [1]. Electrical stimulation in the hypothalamus induced stimulation-evoked (or –bound) attack behavior, where rat studies [2–5] created an important framework underlying the functional organization of attack circuitry [6]. Lesion experiments in mice [7] and rats [8, 9] also implicate parts of the hypothalamus in offensive and defensive aggression [9, 10].

Anterior hypothalamic lesions, damaging large parts of the anterior hypothalamus (AH), rostral parts of the ventromedial hypothalamus (VMH), and smaller parts of the caudal preoptic area (PA), indeed, strongly increase defensive behavior toward a male intruder. Mammillary body lesions, damaging large parts of the ventral (vPMV) and dorsal premammillary nucleus (dPMV), caudal parts of the

arcuate nucleus, medial mammillary nucleus (mMM), posterior mammillary nucleus (pMM), supramammillary peduncle induced strong increases in offensive aggression [9]. These findings suggested the existence of at least two distinct neural substrates in the hypothalamus normally modulating defensive (anterior medial hypothalamus) and offensive (posterior medial hypothalamus) aspects of intermale aggression. Concomitant studies strongly support the ventral premammillary nucleus as a possible central hub of aggression [11]. Because electrolytical lesions are rather nonspecific, i.e., it is virtually impossible to wipe out, on both sides of the brain, one structure without damaging other structures including neurons and fibers of passage. Alternatively, electrical (micro) stimulation can be used to study the role of the underlying substrate (again neurons and fibers of passage) in certain behaviors, including aggression (and sexual behavior).

Already early in the twentieth century [1], hypothalamic stimulation in cats induced attacks. In the seventies [2, 3], this research extended to rats where electrical stimulation in the (ventrolateral) hypothalamus induced attack behavior, although rather nonspecific in that different subjects (mice (live or dead), rat pups, guinea pigs, and adult rats) were attacked. At the end of the seventies, the groups of Koolhaas in Groningen and Kruk in Leiden extensively investigated that upon electrical stimulation in hypothalamic structures, specific behavioral responses were elicited [4, 5]. The Kruk group [12] described, after extensive and meticulous studies, an "aggressive area," later named the "Hypothalamic Aggression Area (HAA)," lateral from the ventrolateral lobe of the ventromedial hypothalamus (VMH) into the frontal pole of the VMH and the anterior hypothalamic nucleus (AHN). This area extends medially to the arcuate nucleus through the ventrolateral and medial parts of the VMH (see for a 3D-picture, Fig. 1 in [13]. The HAA largely (or completely) coincides with the area in the hypothalamus that upon lesioning leads to reduced aggression [9]. In female rats, aggression can be evoked in the same (HAA) area as in males [14].

Recent studies applying genetically defined functional manipulations showed that the VMH and in particular the ventrolateral part (vlVMH) and the medial amygdala are critical sites to evoke aggression [15]. The VMH receives direct and indirect input from the medial amygdala and from the bed nucleus of the stria terminalis (principal nucleus:BNSTpr), but also from various other structures [16], such as the ventral premammillary nucleus (vPMN), the lateral septum (LS), and subparaventricular zone (SPZ) [17].

Newman [18] argued already that the neurobiology of aggressive behavior is embedded in a larger and integrated network of various social behaviors, including sexual and parental behavior. This implies that the neural circuitry involved in these behaviors must consist of a number of commonly activated brain areas (sensitive to a variety of shared cues) and separately by brain areas specifically involved in a specific function or a selective role in each behavior, as, e.g., occurs in the vomeronasal circuitry [19].

The putative "dual" or "multiple" involvement of a specific neural area (node) in, e.g., aggression and sexual behavior necessitates testing the effects of manipulations of this node in other behaviors, e.g., exploratory or other behaviors. Veening and coworkers [20] approached this question by studying whether the patterns of brain activation during male rat aggression and sexual behavior are specific for either behavior or show (partly) overlapping patterns. By using Fosimmunoreactivity, it was shown that some brain areas (caudal medial preoptic area and medial amygdala) were commonly activated, whereas other areas (posterodorsal parts of the medial amygdala, rostral preoptic and premammillary hypothalamus) show differences in neural activation. This is in line with the idea that aggressive and sexual behaviors share partly integrated neural pathways, next

*Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

to more specific "aggressive" and "sexual" brain areas. In general, the medial preoptic nucleus (MPN) and the VMHvl are essential regions for male sexual and aggressive behavior, respectively. Estrogen receptor alpha (ESR1)-expressing cells in the posterior amygdala (PA) are a main source of excitatory input to the hypothalamus and are main mediators for mating and fighting in male mice [21]. PAEsr1+ neurons to the MPN are activated during sexual behavior and also induce sexual behavior. PAEsr1+ neurons that project to the VMHvl promote attacks. The PA can be considered a key node in male aggressive and sexual behavior circuitry. Optogenetic activation of VMHvl cells expressing estrogen receptor alphaprogesterone receptors induced attack, whereas pharmacogenetic optogenetic inactivation of the VMHvl inhibited naturally occurring aggression [17], Moreover, the VMHvl is also involved in generating preparatory (learned) behaviors associated with the attacks [22]. Available evidence gives an essential role to the medial hypothalamus in the generation of aggression, the hypothalamic aggression area or circuit. This hypothalamic aggression circuit is embedded, upstream and downstream, in other circuits that modulate the aggression outcome, e.g., the dopaminergic mesolimbic dopamine pathway. Its connection from the ventral tegmental area (VTA) to the nucleus accumbens (NAc) is a key circuit in the rewarding control of aggression [17, 23].

Optogenetic stimulation of the network in the HAA that evokes aggression [15] was also able to evoke mounting. The neurons involved (estrogen-1 (Esr1) expressing) in the VMHvl evoke mounting upon stimulation with lower frequencies [24]. The VMHvl neurons are sensitive to varying levels of optogenetic stimulation and the (behavioral) outcome ranges from highly prosocial (sexual) to antisocial (aggression). Apparently, one could assume that the VMHvl, and specifically one type of neuron (Esr1<sup>+</sup> ), is an overlapping node in male aggression and sexual behavior circuits [25].

For a long time, it was a common belief that male aggressive and sexual behavior shares many of the underlying neurobiological, neurological, pharmacological, physiological, and neuroendocrine mechanisms. This seems, at least partly, true for aggression and sexual behavior. Apparently, such a shared structure (e.g., the VMHvl) mediates multiple social behaviors and processes [26]). Factors such as social experience, behavioral context, hormonal state, spatial and sensory cues probably (co)-influence which behavior is generated at a specific moment and time [27].

## **2. Serotonin and sexual behavior**

Sexual behavior systems operate under rather constant inhibitory control to ascertain that sexual behavior is performed only under appropriate circumstances. Serotonergic neurotransmission is involved in inhibitory and disinhibitory processes regulating proper sexual behavior. 5-HT release, facilitating transmission, is regulated via negative feedback mechanisms, through different presynaptic (5-HT1A, 5-HT1B/1D) autoreceptors. Moreover, postsynaptic serotonergic heteroreceptors are also involved in negative feedback on serotonergic cell firing [28]. The 5-HT transporter (5-HTT or SERT) plays an important role in homeostatic modulation of the magnitude, duration, and spatial distribution of signals reaching serotonin receptors [29, 30]. Although 5-HT is not considered a central modulator of sexual behavior, but rather modulatory or facilitating, 5-HT activity plays an important role during sexual behavior, via its machinery of pre- and postsynaptic interactions, thereby critically interfering with GABA-ergic and glutamatergic neurons in various brain areas (prefrontal cortex, hypothalamus, lateral habenula, and dorsal raphe nucleus). Serotonergic fibers are abundant in many areas of the spinal

cord implicated in ejaculatory processes [31]. Postsynaptic 5-HT receptors are located at lumbar spinothalamic cells [32], indicative of a role of 5-HT in ejaculation at the level of the spinal cord, descending from supraspinal areas such as the nPGI. These descending 5-HTergic neurons from supraspinal areas innervate spinal cord mechanisms that control bulbospongiosus muscles, which have inhibitory effects on ejaculation [32]. At hypothalamic level, the medial preoptic area (mPOA) is involved in lowering an ejaculatory threshold via inhibition of an inhibitory serotonergic tone exerted by the nPGI [33, 34], removing a brake on ejaculatory processes. The lateral hypothalamic area (LHA) is also involved in ejaculation: lesions affect ejaculation, but not preceding mounts and intromission [35]. Because 5-HT is released in the LHA at the occurrence of ejaculation and infusion of selective serotonin reuptake inhibitors (SSRIs) into this area influences sexual behavior [36], a role of serotonin is clearly implicated. The main sources of 5-HTergic innervation of the forebrain emerge from the dorsal (DRN) and medial (MRN) raphe nuclei. Ascending 5-HTergic fibers are divided into a meso-limbic pathway from the MRN and a meso-striatal pathway derived from the DRN [31, 37, 38]. Although DRN and MRN have (partly) overlapping projections, they do not overlap in the projected structure but go to different subareas [38]. MRN and DRN have reciprocal connections, and both structures express high densities of 5-HT1A receptors. An unanswered question is whether and how these extremely complex interactions (including those with non-serotonergic structures) interact during sexual behavior [39, 40]. Most research in these areas is performed in males (mostly rodents).

Notwithstanding an extensive role of serotonin in aggression and sexual behavior [29, 41] in the present chapter, we focus on the role of two receptors, 5-HT1A and 5-HT1B receptors because they appear as most relevant in interactions between aggressive and sexual behaviors (**Figure 1** shows a cartoon of a serotonergic neuron

#### **Figure 1.**

*Cartoon of a serotonergic neuron projecting to two non-serotonergic neurons. Fourteen different serotonergic receptors are located either as presynaptic autoreceptors (5-HT1A, 5-HT1B) or as postsynaptic heteroreceptors (all 14 receptors). The 5-HT transporter (SERT) is located at the somadendritic and synaptic part of the serotonergic neuron. See text for further details.*

## *Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

with all 14 different 5-HT receptors). 5-HT1A receptors are present as somatodendritic autoreceptors on serotonergic neurons that present upon activation as negative feedback on cell firing, thus inhibiting 5-HT release and thereby exerting a broad influence on 5-HTergic tone. 5-HT1A receptors are also widely distributed in terminal areas of the brain expressed as postsynaptic heteroreceptors in a variety of different brain structures and influence a wide scale of neuropsychopharmacological events [42]. 5-HT1B receptors and its counterpart 5-HT1D receptor have a long, complex, and debated history (see Figure 3 in [42]), because of species differences in function and structure. It was finally confirmed that 5-HT1B and 5- HT1D receptors represent two different receptor classes, and the 5-HT1B-receptor (including the rat 5-HT1B-receptor) plays the most prominent functional role, although the pharmacology of ligands for the human and rodent 5-HT1B receptors can be quite deviating. Most of animal behavioral data on 5-HT1B receptor ligands have been gathered in rodents, which makes prediction for human applications sometimes unreliable [42]. 5-HT1B receptors are present as inhibitory autoreceptor on the presynaptic part of 5-HT neurons (see **Figure 1**) and as inhibitory heteroreceptor on non-serotonergic neurons [42]. Although it is unclear whether every single 5-HT neuron is equipped with similar autoreceptors, at least for the MRN and DRN it is known that they possess somatodendritically localized autoreceptors and presynaptically localized 5-HT1B autoreceptors and 5-HT transporters. 5-HT activity has to be terminated, which is effectuated via reuptake of 5- HT by the serotonin transporter (SERT), a complex molecule with 13 transmembrane loops. After this uptake over the cell membrane via the SERT from the synapse, 5-HT is subsequently taken up by the vesicular-monoamine transporter (VMAT2) and stored in the synaptic vesicles for reuse. Another major route to end serotonergic activity is a process whereby 5-HT is taken up by the surrounding glia cells and degraded by the enzyme monoamine-oxidase-A (MAO-A) [43] to its metabolite 5-hydroxyindole acetic acid (5-HIAA). Simultaneously, the released 5- HT activates 5-HT1B autoreceptors leading to inhibition of further 5-HT release from the vesicles and activates also the somatodendritical 5-HT1A autoreceptors, leading to inhibition of cell firing [44, 45]. The interplay between these three mechanisms (5-HT reuptake, inhibition of release via activation of 5-HT1B autoreceptors, and inhibition of cell firing via activation of somatodendritic 5-HT1A autoreceptors) reduces the activity of the serotonergic neurons after activity, preparing the neuron for a new discharge [44, 45]. Of course, many non-serotonergic inputs are acting on serotonergic cells in the raphé nuclei (a nice schematic overview is shown in Fig. 2 in [46]).

## **3. 5-HT1A and 5-HT1B receptors in aggressive and sexual behavior**

The prototypic 5-HT1A-receptor agonist ()-8-OH-DPAT was developed in the early eighties and when tested on male rats, showed a remarkable stimulation of male sexual behavior [47]. The effects of the racemic ()-8-OH-DPAT and its active enantiomer (+)-8-OH-DPAT have been confirmed in many subsequent studies [31]. Veening and Coolen [48] presented a so-called "funnel-model" of sexual behavior in the rat, based on experiments on feeding, sexual and aggressive behavior combined with electrical stimulation in the ventromedial hypothalamus [49]. The "funnel-model" also applies to other behavioral systems, including aggressive behavior. In general, in the initiation phase 1, the animal involved gathers information about the environment (scanning, sniffing, orientation), followed by transition to phase 2 where appetitive behavior becomes prominent (anogenital sniffing, mounting in case of sexual behavior; following, anogenital

sniffing in aggression). Transition to phase 3 may follow, which is the consummatory/executive phase. In case of sexual behavior, this includes mounting, intromission, and finally, ejaculation; in aggression, this includes lateral threat, biting, jump attacks, keeping down, and chasing [9].

Both sexual and aggressive behavior in male rats can be described by a "funnel" like pattern of behavior [49–51]. By manipulations such as electrical stimulation or lesions in the (ventro)medial hypothalamus, this pattern of behavioral funneling can be interrupted, e.g., electrical stimulation in the VMH in a resident-intruder situation [49] strongly reduces the chance on full aggression, because the stimulation strongly promotes return to phase 1 (scanning and initiation phase). Remarkably, stimulation (either electrically or optogenetically) of the VMHvl in mice can evoke both aggressive and sexual behavior [25, 52–54]. Extensive studies indicate that intermingled, antagonistic brain circuits for aggressive and sexual behavior are present in the VMHvl [15, 55].

Administration of 5-HT1A-receptor agonists (e.g., 8-OH-DPAT, flesinoxan, buspirone, ipsapirone, and others [31]) dose-dependently increases the number of ejaculations and reduces the ejaculation latencies during a certain test duration (e.g., 30 min). Moreover, the number of mounts and intromissions during the successive ejaculation series decrease (**Figure 2**). This whole profile has been described as "pro-sexual" and can be aligned with the funnel-model hypothesis, assuming that 5-HT1A-receptor activation strongly drives the direction of sexual behavior toward the final consummatory phase, ejaculation.

Recently, we tested some new 5-HT1A-receptor agonists on male rat sexual behavior [56]. They are so-called "biased" or "functionally selective" high potency 5-HT1A-receptor agonists, F15599 and F13714, and have distinct pre- and postsynaptic agonistic activity [57]. However, like in aggression (see later), both "biased" agonists had potent pro-sexual activity, comparable to "classic" 5-HT1A-receptor agonists such as 8-OH-DPAT or flesinoxan (similar activation of 5-HT1A auto- and heteroreceptors). However, S-15535, primarily considered a 5-HT1A-autoreceptor agonist and heteroreceptor antagonist, had no pro-sexual activity at all, and also no sexual inhibitory activity either [56]. This strongly suggests that "pro-sexual" activity induced by 5-HT1A receptor agonists is primarily caused by activation of postsynaptic 5-HT1A heteroreceptors.

5-HT1B-receptor agonists inhibit male sexual behavior in the rat [58–60] and in the mouse [61]. Eltoprazine, a mixed 5-HT1A/1B receptor (partial) agonist [62], dosedependently reduced male rat sexual behavior; at no dose tested, pro-sexual effects were seen, indicating that the putative 5-HT1A receptor activating effects of eltoprazine were "overshadowed" by the 5-HT1B-receptor agonistic effects and that the behavioral effects were caused by 5-HT1B-receptor activation. A comparable mixed 5-HT1A/1B-receptor agonistic profile in other putative 5-HT1B receptor agonists such as mCPP, TFMPP, RU24969, and anpirtoline, which all have inhibitory sexual effects in male rats, points to the dominance of 5-HT1B receptors over 5-HT1A receptors upon concomitant activation. In mice, in contrast to rats, 5-HT1A-receptor agonists (8-OH-DPAT) have an inhibitory effect in male sexual behavior [61] (**Figure 3**).

In our studies on 5-HT1A-receptor knockout mice [64–66], we tested three strains of mice (the background strains used to produce the gene knockouts; 129Sv/ Ev, C57Bl/6, and Swiss Webster) in male sexual behavior. **Figure 4** shows the data on number of mounts, intromission, and ejaculations and intromission and mount latencies during male/estrus female tests of 1500 s duration (25 min). In 129Sv/Ev and C57Bl/6 strains, wild-type (WT) mice had significant higher sexual behavior levels than the respective 5-HT1A-receptor knockout mice. Swiss Webster mice hardly showed any sexual behaviors, neither in WT, nor in KO animals, making conclusions impossible.

*Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

#### **Figure 2.**

*Time course of sexual behavior of male rats treated with vehicle (top), ()-8-OH-DPAT (middle), and eltoprazine (bottom) at behaviorally active dosages. M = mount, I = intromission, PEL = post-ejaculatory interval, ES = ejaculation series, EL = ejaculation latency, ML = mount latency, IL = intromission latency. Numbers (1, 2, 3, … ) indicate in which ejaculation series (ES) the behavior parameter is scored.*

5-HT1B-receptor knockout mice (in 129/SV-ter strain) have a lower baseline of sexual behavior than the corresponding wild-type mice [61]. TFMPP, a 5-HT1Breceptor agonist had no behavioral effects in 5-HT1B receptor knockout mice, whereas it dose-dependently decreased male sexual behavior in wild-type mice. Intriguingly, 8-OH-DPAT also dose-dependently decreased male sexual behavior in WT and had, at these doses, no effect in the KO mice. In another mouse strain (NMRI), 8-OH-DPAT had also inhibitory effects on male mouse sexual behavior [67].

There appears a clear species difference between mice and rats regarding 5-HT1A-receptor modulation of male sexual behavior. In contrast, such a species difference is not present in 5-HT1B-receptor modulation. 5-HT1B-receptor agonists inhibit both male aggression and sexual behavior in mice and rats. Selective 5-HT1A-

#### **Figure 3.**

*Effects of a 5-HT1A-receptor agonist (()-8-OH-DPAT) and a 5-HT1B-receptor agonist (eltoprazine) on male sexual behavior of Wistar rats. The number of ejaculations (top left), mounts (left bottom), and intromissions (right bottom) and the ejaculation latency (top right-in seconds) are shown. 8-OH-DPAT was subcutaneously administered 30 min before testing; eltoprazine orally 60 min before testing. \* indicates significant difference (p < 0.05) from vehicle (0 mg/kg). In the figures of ejaculation latency and number of mounts and intromission, at higher doses of eltoprazine, no data are available because of absence of sexual behavior. Data are derived from [63] and Olivier-unpublished 1991.*

receptor antagonists (e.g., WAY100,635) have no intrinsic behavioral effects in either sexual or aggressive behavior, either in mice or rats [68–76]. No studies have been published on effects of 5-HT1A-receptor antagonists on male aggression or sexual behavior in 5-HT1A or 5-HT1B-receptor knockout mice.

There are limited data on chronic treatment with 5-HT1A- or 5-HT1B-receptor agonists on male sexual behavior. Flesinoxan, a classic 5-HT1A-receptor agonist, was given twice daily for 14 days at 2.5 mg/kg, IP. Animals were tested acutely, subchronically (after 7 days) and chronically (after 14 days) on sexual behavior against an estrus female. Acutely, flesinoxan had pro-sexual effects, but no effects were observed after chronic administration, suggesting some tolerance [77]. The effects of a selective 5-HT1B-receptor agonist CP-94253 (injected subcutaneously four times daily with 5 mg/kg) were also tested acutely and after 7 and 14 days. CP-94253 inhibited sexual behavior at all time points, showing that it did not induce tolerance [77].

Removing (gene knockout) 5-HT1A receptors from all neurons normally bearing them (serotonergic somatodendritic autoreceptors) and non-serotonergic neurons with 5-HT1A heteroreceptors [29] has behavioral consequences for male sexual behavior but not for male aggressive behavior. Removing 5-HT1B receptors from serotonergic synapses (inhibitory autoreceptors) and inhibitory postsynaptic 5-HT1B heteroreceptors) has contrasting effects on male sexual and aggressive behavior: male 5-HT1B receptor knockout mice have reduced sexual behavior, whereas male aggressive behavior is enhanced [78, 79].

*Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

**Figure 4.**

*Sexual behavior parameters of 5-HT1A-receptor knockout (5-HT1AKO) and wild-type (WT) mice of three different strains. Latencies are expressed in seconds. Statistics: Repeated measures analysis with two time points. \* P < 0.05; \*\* P < 0.005; # P = 0.07.*

Development of a tissue-specific and temporally conditional 5-HT1B-receptor mouse model [80] brought more insight. It was shown that aggressive behavior is mediated by developmental expression of 5-HT1B heteroreceptors. Whole-life, whole-brain elimination of 5-HT1B receptors led to enhanced aggression, like present in constitutive knockout mice [78, 79]. Rescue of 5-HT1B-receptor expression in early postnatal development, but not in adulthood, ameliorated aggression. It was shown that forebrain 5-HT1B heteroreceptors mediated this aggression phenotype, while reduction of 5-HT1B autoreceptors had no effect on aggression. Apparently, a developmental sensitive period exists, during which the presence of serotonin affects the development of adult aggression.

## **4. Are effects of 5-HT1A-receptor agonists and 5-HT1B-receptor agonists on male aggression and sexual behavior mediated by presynaptic (autoreceptor) or postsynaptic (heteroreceptor) serotonin receptors?**

The big question is whether specific effects induced by activating very heterogeneous 5-HT1 (A or B) receptors on very specific behavioral systems (aggression and sexual behavior) that are functioning via specific and localized neural circuitry in

the brain can be influenced via the extremely nonspecific influence of autoreceptors on the serotonergic cell bodies (5-HT1A autoreceptors) or the serotonergic synaptic endings (5-HT1B autoreceptors). Remarkable is at least that selective 5-HT1A-receptor antagonists, blocking somatodendritic autoreceptors and basically leading to enhanced 5-HT release in serotonergic synapses, do not induce behavioral effects (at least in aggression and sexual behavior). Of course, the enhanced 5-HT levels are also not able to stimulate 5-HT1A heteroreceptors because 5-HT1A receptor antagonists block these too, but other 5-HT receptors are not blocked and could be instrumental in emerging behaviors. This apparently does not happen: 5-HT1A receptor antagonists are generally intrinsically silent, i.e., they do not exert intrinsic behavioral effects [51, 71, 74]. Whether 5-HT1B autoreceptors plus serotonin transporters completely compensate for the effects of blocking 5-HT1A receptors on 5-HT release is largely unknown, but seems less likely. Although certainly not conclusive, we postulate that the pro-sexual effects of 5-HT1A-receptor agonists on male sexual behavior are mediated via postsynaptic 5-HT1A heteroreceptors. Abundant presence of 5-HT1A receptors in areas containing (parts of) neural circuitry involved in all aspects of sexual behavior (e.g., the hypothalamic circuitries [52, 55]) makes this a likely hypothesis, although microinjection of selective 5-HT1A receptor ligands in nodes of these circuits is badly needed.

In aggression, the role of 5-HT1A receptors is also not evident. Although 5-HT1Areceptor agonists have strong anti-aggressive effects in various aggression models in rodents (intermale aggression, resident-intruder aggression, colony aggression, isolation-induced aggression, and others [62, 81], these anti-aggressive effects often coincide with associated nonspecific behavioral effects such as sedation or motor retardation [29, 71, 76]. The selective but low efficacy 5-HT1A-receptor agonist S-15535, acting preferentially as a 5-HT1A-receptor autoreceptor agonist and as a (partial) 5-HT1A-heteroreceptor antagonist, rather selectively decreased aggressive behavior [76], suggesting that the "classical" 5-HT1A-receptor agonists (that activate auto- and heteroreceptors) induce the "nonspecific" anti-aggressive effects via heteroreceptor activation.

The emergence of so-called "biased" or "functionally selective" 5-HT1A-receptor agonists yielded the possibility to study selectively presynaptic 5-HT1Aautoreceptors versus postsynaptic 5-HT1A-heteroreceptors. F15599 is an extremely effective 5-HT1A-heteroreceptor agonist, with relatively low activity at autoreceptors [57, 82]. F13714 is also an effective 5-HT1A-receptor agonist, but primarily activates 5-HT1A-autoreceptors [57, 82]. Both "biased" agonists have antiaggressive effects in extremely aggressive (violent) semi-wild rats [72]: no difference in their anti-aggressive profile was found, making conclusions about specific roles of pre- versus postsynaptic 5-HT1A receptors in aggression more complex.

Although all 5-HT1A-receptor agonists upon acute administration seem to inhibit aggressive behavior in mice and rats, classic 5-HT1A-receptor agonists such as 8-OH-DPAT and flesinoxan do not inhibit aggression induced by electrical stimulation in the hypothalamic attack area (HAA) in male rats [6, 12, 81, 83]. It is remarkable and unexpected that direct activation of "aggression neurons or circuitry" in the HAA (including the VMHvl) cannot be inhibited by activation of 5-HT1A receptors in the brain. This sharply contrasts by 5-HT1B-receptor activation (e.g., by eltoprazine, fluprazine, or TFMPP) that dose-dependently decreases attacks (measured by enhanced stimulation thresholds), but does not influence locomotion thresholds (or even decrease them) and also dose-dependently reduces teeth chattering, an associated (autonomic) aggressive element [6, 12, 81, 83].

5-HT1B-receptor agonists inhibit offensive aggression in mice, rats, and other species (e.g., monkeys and pigs) [29, 62, 84]. Other groups have confirmed that activation of 5-HT1B receptors leads to reduction of aggression [71, 85]. Support for *Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

an important role of postsynaptic 5-HT1B receptors has been found by the Miczek group [86, 87] and several other sources [88]. Overwhelming evidence suggests that postsynaptic (heteroreceptor) 5-HT1B receptors are involved in the mediation of specific anti-offensive aggression (serenic) activity [29]. Considerable efforts still need to be made to unravel the neural localization of these postsynaptic 5-HT1B receptors, because several conflicting data exist.

A weak and underreported aspect of aggression (and sexual behavior) research is that studies are almost only performed after acute administration. No chronic aggression studies with 5-HT1A-receptor agonists have been performed as far as we are aware. For 5-HT1B-receptor agonists, some chronic aggression studies in mice and rats were performed. Fluprazine, an early serenic [90, 91], was tested in wild house mice that were selected for a high level of aggression, measured by the attack latency when confronted with a male opponent [89]. Sixteen wild male mice of the SAL-line were selected for Short Attack Latencies (<100 s) and were trained in three successive 10-min trials to reach a stable short attack latency (**Figure 5A**-pre value). In the fourth trial, eight mice received saline (IP) and eight mice received fluprazine (20 mg/kg IP, 30 min before testing). **Figure 5A** shows the strong antiaggressive activity of acutely administered fluprazine. Chronic administration was performed using osmotic minipumps. Saline had no effects on the latency time, whereas after 7 days of 400 mg/kg/day via minipump administration, fluprazine had strong anti-aggressive activity (**Figure 5B**). Although the chronic effects of fluprazine seemed diminished compared with acute dosing, it was unknown whether a dose of 400 mg/kg/day led to comparable plasma levels of fluprazine than after acute administration, although some tolerance (desensitization of 5-HT1B receptors) might be possible. However, this seems unlikely seen the results of a chronic study with eltoprazine in male Tryon Maze Dull (TMD-S3) rats, a strain

#### **Figure 5.**

*Effects of fluprazine on attack latencies (sec) of wild house mice selected for aggressive behavior. Panel A shows the acute effects of vehicle and fluprazine 20 mg/kg IP. Panel B shows the effects after 7 days treatment of chronic vehicle or chronic fluprazine (200 mg/kg SC) administered via Alzet® osmotic minipumps [89].*

with a high level of residential aggression [92]. After initial training, male rats were used for the resident-intruder test during a 4-week treatment period. Eltoprazine (0, 1, and 3 mg/kg PO) was given 60 min before a 10-min aggression test. Acutely, eltoprazine reduced offensive aggression without any effects on social and nonsocial behaviors. Subsequently, eltoprazine or vehicles were daily administered for 4 weeks, and a resident-intruder test was performed once weekly. The antiaggressive effects of eltoprazine remained stable over the 4-week period, whereas exploration was enhanced, but no adverse effects were found. After a washout of 1 week aggressive behavior returned to baseline. These data showed no tolerance for the anti-aggressive effects of eltoprazine [93]. In a comparable study using osmotic minipumps for 7 days with 20-mg/kg/day eltoprazine, also no evidence was found for tolerance to the anti-aggressive activity confirming the specificity of the effects [94].

## **5. Overview of serotonin, sexual behavior, and aggression**

**Table 1** summarizes effects of 5-HT1A and 5-HT1B-receptor agonists on male sexual and aggressive behavior in mice and rats. 5-HT1A-receptor agonists enhance male sexual behavior in the rat, but decrease it in the mouse. In contrast, 5-HT1Areceptor agonists decrease male aggression in most offensive aggression models in mice and rats, although not in a very essential model, HAA stimulation in rats and behavioral effects are often not very specific, and induced side effects such as sedation or sensoric-motor disturbances might be (co)-causative in the reduction of offensive behavior.

In contrast, 5-HT1B-receptor agonists show highly specific anti-aggressive effects in all offensive aggression models and also reduce male sexual behavior. Neither 5-HT1A-receptor antagonists, nor 5-HT1B-receptor antagonists exert any behavioral effects in either male aggression or male sexual behavior models. Chronic administration of 5-HT1A-receptor agonists seems to induce tolerance, whereas 5-HT1B-receptor agonists do not.

These profiles favor 5-HT1B-receptor agonists over 5-HT1A-receptor agonists with regard to anti-aggressive activity, whereas 5-HT1A-receptor agonists may have a role in pro-sexual effects that may be useful in certain male human sexual dysfunctions, e.g., delayed ejaculation.

In the following part, the history of the development of specific anti-aggressive (offensive) drugs is depicted (**Box 1**).


#### **Table 1.**

*Summary of effects of 5-HT receptor ligands on male aggressive and sexual behavior in mice and rats.*

The discovery and development of drugs, specifically aimed at reduction of pathological aggression and destructive behavior in psychiatric patients, were started halfway the seventies of last century by Philips-Duphar in the Netherlands. It was already at that time clear that pathological destructive behavior, sometimes named "aggressive," "violent," "agitated," or "dysfunctional," is widely present in psychiatric and neurological disorders and cannot, even up to this time, adequately be treated with psychotropic drugs. A striking variety of drugs were and are used in patients with these severely troubled behavioral disturbances, including neuroleptics or hypnotics, mainly used for their sedative properties, benzodiazepines, lithium, beta-blockers antidepressants and anticonvulsants [95].

In the mid-seventies, Philips-Duphar started a search for specific anti-aggressive drugs. At that time, the pre-molecular era, there was no clue for which target to search, and consequently, the quest for antiaggressive drugs was steered by animal aggression models and tests [96]. One of the authors (BO) was hired by Philips-Duphar because of their expertise and background in aggression models and brain mechanisms involved in aggression [29]. Throughout the sixties and seventies, pharmacological laboratories used simple but often unnatural animal models involving various aspects of agonistic behaviors (offense, defense, flight) to detect psycho-activity of newly synthesized drugs; the aim was not to detect "anti-aggressive" drugs as therapeutics but merely a read-out for psychoactive effects. For example, neuroleptic activity in a molecule could be easily detected using isolation-induced fighting in male mice [97]. Such models are functionally simple to run and score and therefore extremely suitable for screening, but they do not reveal the mechanism of action and do not predict the specificity of the observed effect and cannot distinguish the compound tested from any other compound that shows pharmacological activity in the model or test.

Because we had no clue about a mode of action to pursue specific anti-aggressive activity in a molecule at that time, a behavioral cascade of animal models of aggressive behavior was created. The "isolationinduced aggression" test in male mice was the primary screening test to determine an ED50 (in mg/kg orally) for aggression reduction. As this measure did not reveal the specificity of the anti-aggressive activity, further tests were developed to measure the behavioral specificity of the aggression reducing effects of psychoactive drugs. By using ethological methods in mice and rats [94] and combined leadfinding and screening of more than 2000 new chemical structures, some phenylpiperazine analogues were found that fulfilled primary pharmacological criteria for a non-sedative anti-aggressive structure. In 1980, after a dedicated search for optimal anti-aggressive activity, DU27716 (fluprazine) was selected for further development. Fluprazine and its later successors (eltoprazine, batoprazine) showed the specific antiaggressive profile in which offensive aggression was reduced, whereas social behavior and exploration were not affected. This profile has been depicted as SERENIC [98]. Eltoprazine was taken into clinical development up to phase 2B, but for several reasons, no phase 3 studies were initiated. Unfortunately, since then (1994), no new developments in the search for serenics have been undertaken.

Serenics were found and developed based on a purely translational basis: animal models of aggression predicting human (pathological) aggression [62]. Although a risky approach, no target-specific search was possible, as the putative underlying mechanisms of action were unknown. In the course of time, however, it became clear that serenics interacted with central serotonergic (5-HT) systems. In the 1980s, the rapid development of receptor binding techniques and the discovery of subtype receptors of various neurotransmitters played an increasing role in the unraveling of the mode of action of drugs. The most prominent feature of serenics was their affinity for serotonergic receptors. Over time [62] it became clear that serenics (eltoprazine) have high affinity for 5-HT1 receptors, specifically for 5-HT1A and 5-HT1B receptors. Further research has shown that eltoprazine exerts its serenic activity because of its (partial) agonistic activity at 5-HT1A and 5-HT1B receptors. There is evidence [88, 99, 100] that serenic activity is mediated postsynaptically via 5-HT1B receptors [84], although a role for 5-HT1A receptors cannot be excluded [71].

Although serotonin has been considered for a long time as a very important neurotransmitter in the modulation of aggression and impulsivity [101], it does not work in isolation; other neurotransmitters clearly play an important role too [86, 102]. Apparently, however, serotonin is a key player in modulation of aggression mechanism and circuitry; a PUBMED search (March 22, 2021) on "aggression" coupled to "serotonin" yields 3010 hits, with "dopamine" 1627 hits, with "noradrenaline" 849 hits, with "GABA" 705 hits, whereas with other neurotransmitters yields lower hits.

The specific search for serenics, independent of the underlying molecular target, has not been pursued after the development stop of eltoprazine in 1994. Since then, fundamental research on aggression has dwindled for some time although many relevant studies in man and animal are still pursued. Verhoeven and Tuinier [103] pleaded for continued research into serenics, strongly supported by Coccaro et al. [101] who "hoped that new insights into the neurobiology of aggression will reveal novel avenues for treatment of this destructive and costly behavior." The recent surge in applying new techniques in neurobiology has also brought exciting findings in the circuitry and genetics of aggression that might facilitate future search for new serenics.

#### **Box 1.**

*Serenics: Drugs with specific anti-aggressive activity.*

## **Author details**

Berend Olivier1,2,3\* and Jocelien D.A. Olivier3

1 Department of Psychopharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands

2 Department of Psychiatry, Yale School of Medicine, New Haven, USA

3 Neurobiology, Groningen Institute for Evolutionary Life Sciences (GELIFES), Rijksuniversiteit Groningen, Groningen, The Netherlands

\*Address all correspondence to: b.olivier@uu.nl

© 2022 The Author(s). Licensee IntechOpen. This chapter is distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/ by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

*Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

## **References**

[1] Hess WR. Stammganglien-Reizversuchen. Berichten der gesamten. Physiologie. 1927;**42**:554-555

[2] Panksepp J. Aggression elicited by electrical stimulation of the hypothalamus in albino rats. Physiology & Behavior. 1971;**6**:321-329. DOI: 10.1016/0031-9384(71)90163-6

[3] Woodworth CH. Attack elicited in rats by electrical stimulation of the lateral hypothalamus. Physiology & Behavior. 1971;**6**:345-353. DOI: 10.1016/ 0031-9384(71)90166-1

[4] Koolhaas JM. Hypothalamically induced intraspecific aggressive behaviour in the rat. Experimental Brain Research. 1978;**32**:365-375. DOI: 10.1007/BF00238708

[5] Kruk MR, van der Poel AM, de Vos-Frerichs TP. The induction of aggressive behaviour by electrical stimulation in the hypothalamus of male rats. Behaviour. 1979;**70**:292-322. DOI: 10.1163/156853979x00106

[6] Siegel A, Roeling TA, Gregg TR, Kruk MR. Neuropharmacology of brainstimulation-evoked aggression. Neuroscience and Biobehavioral Reviews. 1999;**23**:359-389. DOI: 10.1016/s0149-7634(98)00040-2

[7] Olivier B, Wiepkema PR. Behaviour changes in mice following electrolytic lesions in the median hypothalamus. Brain Research. 1974;**65**:521-5244. DOI: 10.1016/0006-8993(74)90241-8

[8] Olivier B. The ventromedial hypothalamus and aggressive behavior in the rat. Aggressive Behavior. 1977;**3**: 47-56

[9] Olivier B, Olivier-Aardema R, Wiepkema PR. Effect of anterior hypothalamic and mammillary area lesions on territorial aggressive

behaviour in male rats. Behavioural Brain Research. 1983;**9**:59-81. DOI: 10.1016/0166-4328(83)90014-1

[10] Olivier B. Behavioural fuctions of the medial hypothalamus in the rat [PhD-thesis]. Rijksuniversiteit Groningen; 1977. pp. 1-220

[11] Van den Berg MJ, ter Horst GJ, Koolhaas JM. The nucleus premammillaris ventralis (PMV) and aggressive behavior in the rat. Aggressive Behavior. 1983;**9**:41-47

[12] Kruk MR. Ethology and pharmacology of hypothalamic aggression in the rat. Neuroscience and Biobehavioral Reviews. 1991;**15**:527-538. DOI: 10.1016/s0149-7634(05)80144-7

[13] Hrabovszky E, Halász J, Meelis W, Kruk MR, Liposits Z, Haller J. Neurochemical characterization of hypothalamic neurons involved in attack behavior: Glutamatergic dominance and co-expression of thyrotropin-releasing hormone in a subset of glutamatergic neurons. Neuroscience. 2005;**133**:657-666. DOI: 10.1016/j.neuroscience.2005.03.042

[14] Kruk MR, Van der Laan CE, Mos J, Van der Poel AM, Meelis W, Olivier B. Comparison of aggressive behaviour induced by electrical stimulation in the hypothalamus of male and female rats. Progress in Brain Research. 1984;**61**: 303-314

[15] Lee H, Lein ES, Perona P, Anderson DJ. Functional identification of an aggression locus in the mouse hypothalamus. Nature. 2011;**470**: 221-226

[16] de Boer SF, Olivier B, Veening J, Koolhaas JM. The neurobiology of offensive aggression: Revealing a modular view. Physiology & Behavior. 2015;**146**:111-127. DOI: 10.1016/j. physbeh.2015.04.040

[17] Yamaguchi T, Lin D. Functions of medial hypothalamic and mesolimbic dopamine circuitries in aggression. Current Opinion in Behavioral Sciences. 2018;**24**:104-112. DOI: 10.1016/j. cobeha.2018.06.011

[18] Newman SW. The medial extended amygdala in male reproductive behavior. A node in the mammalian social behavior. Annals. New York Academy of Sciences. 1999;**877**:242-257

[19] Kumar A, Dudley CA, Moss RL. Functional dichotomy within the vomeronasal system: Distinct zones of neuronal activity in the accessory olfactory bulb correlate with sex specific behaviors. The Journal of Neuroscience. 1999;**19**:RC32. DOI: 10.1523/ JNEUROSCI.19-20-j0003.1999

[20] Veening JG, Coolen LM, de Jong TR, Joosten HW, de Boer SF, Koolhaas JM, et al. Do similar neural systems subserve aggressive and sexual behaviour in male rats? Insights from c-Fos and pharmacological studies. European Journal of Pharmacology. 2005;**526**:226-239. DOI: 10.1016/j.ejphar.2005.09.041

[21] Yamaguchi T,Wei D, Song SC, Lim B, Tritsch NX, Lin D. Posterior amygdala regulates sexual and aggressive behaviors in male mice. Nature Neuroscience. 2020; **23**:1111-1124. DOI: 10.1038/s41593-020- 0675-x

[22] Falkner AL, Grosenick L, Davidson TJ, Deisseroth K, Lin D. Hypothalamic control of male aggression-seeking behavior. Nature Neuroscience. 2016;**19**:596-604. DOI: 10.1038/nn.4264

[23] Yu Q, Teixeira CM, Mahadevia D, Huang Y, Balsam D, Mann JJ, et al. Dopamine and serotonin signaling during two sensitive developmental periods differentially impact adult aggressive and affective behaviors in mice. Molecular Psychiatry. 2014;**19**: 688-698. DOI: 10.1038/mp.2014.10

[24] Lee H, Kim DW, Remedios R, Anthony TE, Chang A, Madisen L, et al. Scalable control of mounting and attack by Esr1+ neurons in the ventromedial hypothalamus. Nature. 2014;**509**: 627-632. DOI: 10.1038/nature13169

[25] Chen P, Hong W. Neural circuit mechanisms of social behavior. Neuron. 2018;**98**:16-30. DOI: 10.1016/j. neuron.2018.02.026

[26] Hashikawa Y, Hashikawa K, Falkner AL, Lin D. Ventromedial hypothalamus and the generation of aggression. Frontiers in Systems Neuroscience. 2017;**11**:94. DOI: 10.3389/ fnsys.2017.00094

[27] Krzywkowski P, Penna B, Gross CT. Dynamic encoding of social threat and spatial context in the hypothalamus. eLife. 2020;**9**:e57148. DOI: 10.7554/eLife.57148

[28] Sharp T. Serotonergic feedback control. In: Muller CP, Jacobs BL, editors. Handbook of Behavioral Neurobiology of Serotonin. Amsterdam: Elsevier; 2010. pp. 233-258

[29] Olivier B. Serotonin: A never-ending story. European Journal of Pharmacology. 2015;**753**:2-18. DOI: 10.1016/j.ejphar.2014.10.031

[30] Murphy DI, Lerner A, Rudnick G, Lesch KP. Serotonin transporter: Gene, genetic disorders and pharmacogenetics. Molecular Interventions. 2004;**4**:109-123

[31] Snoeren EM, Veening JG, Olivier B, Oosting RS. Serotonin 1A receptors and sexual behavior in male rats: A review. Pharmacology, Biochemistry, and Behavior. 2014;**121**:102-114. DOI: 10.1016/j.pbb.2013.11.007

[32] Marson L, McKenna KE. A role for 5-hydoxytryptamine in descending inhibition of spinal sexual reflexes. Experimental Brain Research. 1992;**88**: 313-320

*Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

[33] Marson L, Gravitt K. Spinal neurons activated with the urethrogenital reflex in the male rat. Brain Research. 2004; **1026**:108-115

[34] Marson L, McKenna KE. Stimulation of the hypothalamus initiates the urethrogenital reflex in male rats. Brain Research. 1994;**638**: 103-108

[35] Kippin TE, Sotiropoulos V, Badih J, Pfaus JG. Opposing roles of the nucleus accumbens and anterior lateral hypothalamic area in the control of sexual behaviour in the male rat. The European Journal of Neuroscience. 2004;**19**:698-704

[36] Lorrain DS, Matuszewich L, Friedman RD, Hull EM. Extracellular serotonin in the lateral hypothalamic area is increased during the postejaculatory interval and impairs copulation in male rats. The Journal of Neuroscience. 1997;**17**:9361-9366

[37] Vertes RP. A PHA-L analysis of ascending projections of the dorsal raphe nucleus in the rat. The Journal of Comparative Neurology. 1991;**313**: 643-668

[38] Vertes RP, Fortin WJ, Crane AM. Projections of the median raphe nucleus in the rat. The Journal of Comparative Neurology. 1999;**407**:555-582

[39] Uphouse L. Pharmacology of serotonin and female sexual behavior. Pharmacology, Biochemistry, and Behavior. 2014;**121**:31-42

[40] Uphouse L, Guptarak J. Serotonin and sexual behavior. In: Muller CP, Jacobs BL, editors. Handbook of Behavioral Neurobiology of Serotonin. Amsterdam: Elsevier; 2010. pp. 347-365

[41] Olivier JDA, Olivier B. Antidepressants and sexual dysfunction; translational aspects. Current Sexual Health Reports. 2019;**11**:156-166

[42] Barnes NM, Ahern GP, Becamel C, Bockaert J, Camilleri M, Chaumont-Dubel S, et al. International union of basic and clinical pharmacology. CX. Classification of receptors for 5 hydroxytryptamine; pharmacology and function. Pharmacology Review. 2021; **73**:310-520

[43] Youdim MB, Edmondson D, Tipton KF. The therapeutic potential of monoamine oxidase inhibitors. Nature Reviews: Neuroscience. 2006;**7**:295-309. DOI: 10.1038/nrn1883

[44] Artigas F. Serotonin receptors involved in antidepressant effects. Pharmacology & Therapeutics. 2013; **137**:119-131

[45] Artigas F. Future direction for serotonin and antidepressants. ACS Chemical Neuroscience. 2013;**4**:5-8

[46] Adell A, Celada P, Abellan MT, Artigas F. Origin and functional role of the extracellular serotonin in the midbrain raphe nuclei. Brain Research Reviews. 2002;**39**:154-180

[47] Ahlenius S, Larsson K, Svensson L, Hjorth S, Carlsson A, Lindberg P, et al. Effects of a new type of 5-HT receptor agonist on male rat sexual behavior. Pharmacology, Biochemistry, and Behavior. 1981;**15**:785-792. DOI: 10.1016/0091-3057(81)90023-x

[48] Veening JG, Coolen LM. Neural mechanisms of sexual behavior in the male rat: Emphasis on ejaculationrelated circuits. Pharmacology, Biochemistry, and Behavior. 2014;**121**: 170-183. DOI: 10.1016/j.pbb.2013.12.017

[49] Veening J. Behavioural functions of the VMH in the rat: An ethological approach [PhD thesis]. Rijksuniversiteit Groningen; 1975. pp. 1-127

[50] Veening JG. Brain and behaviour: Morphological and functional aspects of the hypothalamus in the rat.

European Journal of Morphology. 1992; **30**:53-66

[51] Olivier JDA, Janssen J, Pattij T, de Prètre S, Olivier B. Antidepressant, sexual behavior and translational models for male sexual dysfunctions: Development of animal models, pharmacology and genetics. In: Kim Y-K, Amidfur M, editors. Translational Research Methods for Major Depressive Disorder. Neuromethods, vol. 179. NewYork: Humana Press; 2021

[52] Anderson DJ. Optogenetics, sex, and violence in the brain: Implications for psychiatry. Biological Psychiatry. 2012; **71**(12):1081-1089. DOI: 10.1016/j. biopsych.2011.11.012

[53] Hashikawa K, Hashikawa Y, Falkner A, Lin D. The neural circuits of mating and fighting in male mice. Current Opinion in Neurobiology. 2016; **38**:27-37. DOI: 10.1016/j. conb.2016.01.006

[54] Yang CF, Chiang MC, Gray DC, Prabhakaran M, Alvarado M, Juntti SA, et al. Sexually dimorphic neurons in the ventromedial hypothalamus govern mating in both sexes and aggression in males. Cell. 2013;**153**:896-909. DOI: 10.1016/j.cell.2013.04.017

[55] Anderson DJ. Circuit modules linking internal states and social behaviour in flies and mice. Nature Reviews. Neuroscience. 2016;**17**: 692-704. DOI: 10.1038/nrn.2016.125

[56] Esquivel-Franco DC, de Boer SF, Waldinger M, Olivier B, Olivier JDA. Pharmacological studies on the role of 5-HT1A receptors in male sexual behavior of wildtype and serotonin transporter knockout rats. Frontiers in Behavioral Neuroscience. 2020;**14**:40. DOI: 10.3389/fnbeh.2020.00040

[57] Newman-Tancredi A. Biased agonism at serotonin 5-HT1A receptors: Preferential postsynaptic activity for

improved therapy of CNS disorders. Neuropsychiatry. 2011;**1**:149-164

[58] Fernández-Guasti A, Escalante A, Agmo A. Inhibitory action of various 5- HT1B receptor agonists on rat masculine sexual behaviour. Pharmacology, Biochemistry, and Behavior. 1989;**34**: 811-816. DOI: 10.1016/0091-3057(89) 90279-7

[59] Fernández-Guasti A, Rodríguez-Manzo G. Further evidence showing that the inhibitory action of serotonin on rat masculine sexual behavior is mediated after the stimulation of 5- HT1B receptors. Pharmacology, Biochemistry, and Behavior. 1992;**42**: 529-533. DOI: 10.1016/0091-3057(92) 90150-e

[60] Hillegaart V, Ahlenius S. Facilitation and inhibition of male rat ejaculatory behaviour by the respective 5-HT1A and 5-HT1B receptor agonists 8-OH-DPAT and anpirtoline, as evidenced by use of the corresponding new and selective receptor antagonists NAD-299 and NAS-181. British Journal of Pharmacology. 1998;**125**:1733-1743. DOI: 10.1038/sj.bjp.0702239

[61] Rodríguez-Manzo G, López-Rubalcava C, Hen R, Fernández-Guasti A. Participation of 5-HT(1B) receptors in the inhibitory actions of serotonin on masculine sexual behaviour of mice: Pharmacological analysis in 5-HT(1B) receptor knockout mice. British Journal of Pharmacology. 2002;**136**:1127-1134. DOI: 10.1038/sj.bjp.0704827

[62] Olivier B, Mos J, Raghoebar M, de Koning P, Mak M. Serenics. Progress in Drug Research. 1994;**42**:167-308. DOI: 10.1007/978-3-0348-7153-2\_6

[63] Chan JS, Snoeren EM, Cuppen E, Waldinger MD, Olivier B, Oosting RS. The serotonin transporter plays an important role in male sexual behavior: A study in serotonin transporter knockout rats. The Journal of Sexual

*Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

Medicine. 2011;**8**:97-108. DOI: 10.1111/ j.1743-6109.2010.01961.x

[64] Groenink L, Pattij T, De Jongh R, Van der Gugten J, Oosting RS, Dirks A, et al. 5-HT1A receptor knockout mice and mice overexpressing corticotropinreleasing hormone in models of anxiety. European Journal of Pharmacology. 2003;**463**:185-197. DOI: 10.1016/ s0014-2999(03)01281-0

[65] Pattij T, Broersen LM, van der Linde J, Groenink L, van der Gugten J, Maes RA, et al. Operant learning and differential-reinforcement-of-low-rate 36-s responding in 5-HT1A and 5-HT1B receptor knockout mice. Behavioural Brain Research. 2003;**141**:137-145. DOI: 10.1016/s0166-4328(02)00345-5

[66] Vinkers CH, Oosting RS, van Bogaert MJ, Olivier B, Groenink L. Early-life blockade of 5-HT(1A) receptors alters adult anxiety behavior and benzodiazepine sensitivity. Biological Psychiatry. 2010;**67**:309-316. DOI: 10.1016/j.biopsych.2009.08.013

[67] Svensson K, Larsson K, Ahlenius S, Arvidsson LE, Carlsson A. Evidence for a facilitatory role of central 5-HT in male mouse sexual behavior. In: Dourish CT, Ahlenius S, Hutson PH, editors. Brain 5-HT1A Receptors: Behavioural and Neurochemical Pharmacology. Chichester: Ellis Horwood; 1987. pp. 199-210

[68] Schijven D, Sousa VC, Roelofs J, Olivier B, Olivier JD. Serotonin 1A receptors and sexual behavior in a genetic model of depression. Pharmacology, Biochemistry, and Behavior. 2014;**121**:82-87. DOI: 10.1016/ j.pbb.2013.12.012

[69] Ahlenius S, Larsson K. Evidence for an involvement of 5-HT1B receptors in the inhibition of male rat ejaculatory behavior produced by 5-HTP. Psychopharmacology. 1998;**137**:374-382. DOI: 10.1007/s002130050633

[70] Ahlenius S, Larsson K. Synergistic actions of the 5-HT1A receptor antagonist WAY-100635 and citalopram on male rat ejaculatory behavior. European Journal of Pharmacology. 1999;**379**:1-6. DOI: 10.1016/s0014-2999 (99)00483-5

[71] de Boer SF, Koolhaas JM. 5-HT1A and 5-HT1B receptor agonists and aggression: A pharmacological challenge of the serotonin deficiency hypothesis. European Journal of Pharmacology. 2005;**526**:125-139. DOI: 10.1016/j. ejphar.2005.09.065

[72] de Boer SF, Newman-Tancredi A. Anti-aggressive effects of the selective high-efficacy 'biased' 5-HT₁A receptor agonists F15599 and F13714 in male WTG rats. Psychopharmacology. 2016; **233**:937-947. DOI: 10.1007/s00213-015- 4173-x

[73] Bell R, Hobson H. 5-HT1A receptor influences on rodent social and agonistic behavior: A review and empirical study. Neuroscience and Biobehavioral Reviews. 1994;**18**:325-338. DOI: 10.1016/0149-7634(94)90046-9

[74] Bell R, Lynch K, Mitchell P. Lack of effect of the 5-HT(1A) receptor antagonist WAY-100635 on murine agonistic behaviour. Pharmacology, Biochemistry, and Behavior. 1999;**64**: 549-554. DOI: 10.1016/s0091-3057(99) 00105-7

[75] de Boer SF, Lesourd M, Mocaer E, Koolhaas JM. Selective antiaggressive effects of alnespirone in residentintruder test are mediated via 5 hydroxytryptamine1A receptors: A comparative pharmacological study with 8-hydroxy-2-dipropylaminotetralin, ipsapirone, buspirone, eltoprazine, and WAY-100635. The Journal of Pharmacology and Experimental Therapeutics. 1999;**288**:1125-1133

[76] de Boer SF, Lesourd M, Mocaër E, Koolhaas JM. Somatodendritic 5-HT(1A) autoreceptors mediate the anti-aggressive actions of 5-HT(1A) receptor agonists in rats: An ethopharmacological study with S-15535, alnespirone, and WAY-100635. Neuropsychopharmacology. 2000;**23**: 20-33. DOI: 10.1016/S0893-133X(00) 00092-0

[77] Li Y, Pehrson AL, Oosting RS, Gulinello M, Olivier B, Sanchez C. A study of time- and sex-dependent effects of vortioxetine on rat sexual behavior: Possible roles of direct receptor modulation. Neuropharmacology. 2017;**121**:89-99. DOI: 10.1016/j.neuropharm.2017.04.017

[78] Bouwknecht JA, Hijzen TH, van der Gugten J, Maes RA, Hen R, Olivier B. Absence of 5-HT(1B) receptors is associated with impaired impulse control in male 5-HT(1B) knockout mice. Biological Psychiatry. 2001;**49**: 557-568. DOI: 10.1016/s0006-3223(00) 01018-0

[79] Saudou F, Amara DA, Dierich A, LeMeur M, Ramboz S, Segu L, et al. Enhanced aggressive behavior in mice lacking 5-HT1B receptor. Science. 1994; **265**:1875-1878. DOI: 10.1126/ science.8091214

[80] Nautiyal KM, Tanaka KF, Barr MM, Tritschler L, Le Dantec Y, David DJ, et al. Distinct circuits underlie the effects of 5-HT1B receptors on aggression and impulsivity. Neuron. 2015;**86**:813-826. DOI: 10.1016/j. neuron.2015.03.041

[81] Olivier B, Mos J, Tulp M, Schipper J, den Daas S, van Oortmerssen G. Serotonergic involvement in aggressive behavior in animals. In: van Praag H, Plutchik R, Apter A, editors. Violence and Suicidality: Perspectives in Clinical and Psychobiological Research. New York, Brunner/Mazel, 1990. 79-137.

[82] Garcia-Garcia AL, Newman-Tancredi A, Leonardo ED. 5-HT(1A) receptors in mood and anxiety: Recent insights into autoreceptor versus heteroreceptor function. Psychopharmacology. 2014;**231**: 623-636. DOI: 10.1007/s00213-013- 3389-x.(Berl)

[83] Olivier B, Mos J, Rasmussen D. Behavioural pharmacology of the serenic, eltoprazine. Drug Metabolism and Drug Interactions. 1990;**8**:31-83. DOI: 10.1515/dmdi.1990.8.1-2.31

[84] Olivier B, van Oorschot R. 5-HT1B receptors and aggression: A review. European Journal of Pharmacology. 2005;**526**:207-217. DOI: 10.1016/j. ejphar.2005.09.066

[85] Olivier B, Mos J, van Oorschot R, Hen R. Serotonin receptors and animal models of aggressive behavior. Pharmacopsychiatry. 1995;**28**(Suppl 2): 80-90. DOI: 10.1055/s-2007-979624

[86] Takahashi A, Quadros IM, de Almeida RM, Miczek KA. Brain serotonin receptors and transporters: Initiation vs. termination of escalated aggression. Psychopharmacology. 2011; **213**:183-212. DOI: 10.1007/s00213-010- 2000-y

[87] Centenaro LA, Vieira K, Zimmermann N, Miczek KA, Lucion AB, de Almeida RM. Social instigation and aggressive behavior in mice: Role of 5- HT1A and 5-HT1B receptors in the prefrontal cortex. Psychopharmacology. 2008;**201**:237-248. DOI: 10.1007/ s00213-008-1269-6

[88] Sijbesma H, Schipper J, de Kloet ER, Mos J, van Aken H, Olivier B. Postsynaptic 5-HT1 receptors and offensive aggression in rats: A combined behavioural and autoradiographic study with eltoprazine. Pharmacology, Biochemistry, and Behavior. 1991;**38**:447-458. DOI: 10.1016/ 0091-3057(91)90305-l

[89] Van Oortmerssen GA, Benus I, Dijk GJ. Studies in wild house mice: Genotype-environment interactions for *Aggression and Sexual Behavior: Overlapping or Distinct Roles of 5-HT1A and 5-HT1B… DOI: http://dx.doi.org/10.5772/intechopen.104872*

attack latency. Netherland Journal of Zoology. 1985;**35**:155-169

[90] Olivier B, van Dalen. Social behavior in rats and mice: An ethological based model for differentiating psychoactive drugs. Aggressive Behavior. 1982;**8**:163-168

[91] van der Poel AM, Olivier B, Mos J, Kruk MR, Meelis W, van Aken JH. Antiaggressive effect of a new phenylpiperazine compound (DU27716) on hypothalamically induced behavioural activities. Pharmacology, Biochemistry, and Behavior. 1982;**17**:147-153. DOI: 10.1016/0091-3057(82)90277-5

[92] Olivier B. Selective anti-aggressive properties of DU 27725: Ethological analyses of intermale and territorial aggression in the male rat. Pharmacology, Biochemistry, and Behavior. 1981;**14**(Suppl. 1):61-77. DOI: 10.1016/s0091-3057(81)80012-3

[93] Mos J, van Aken HH, van Oorschot R, Olivier B. Chronic treatment with eltoprazine does not lead to tolerance in its anti-aggressive action, in contrast to haloperidol. European Neuropsychopharmacology. 1996;**6**:1-7. DOI: 10.1016/0924-977x(95)00051-p

[94] Olivier B, Rasmussen D, Raghoebar M, Mos J. Ethopharmacology: A creative approach to identification and characterisation of novel psychotropics. Drug Metabolism and Drug Interactions. 1990;**8**:11-29. DOI: 10.1515/dmdi.1990.8.1-2.11

[95] Rasmussen DL, Olivier B, Raghoebar M, Mos J. Possible clinical applications of serenics and some implications of their preclinical profile for their clinical use in psychiatric disorders. Drug Metabolism and Drug Interactions. 1990;**8**:159-186. DOI: 10.1515/dmdi.1990.8.1-2.159

[96] Olivier B, Raghoebar M, Mos J, Hartog J. Rasmussen D. Serenics: An introduction. Drug Metabolism and Drug Interactions. 1990;**8**:1-9

[97] Janssen PAJ, Jageman AH, Niemegeers JE. Effects of various drugs on isolation-induced fighting behavior of male mice. The Journal of Pharmacology and Experimental Therapeutics. 1959;**125**:471-475

[98] Olivier B, van Dalen D, Hartog J. A new class of psychoactive drugs: Serenics. Drugs of the Future. 1986;**11**: 473-499

[99] Mos J, Olivier B, Poth M, van Aken H. The effects of intraventricular administration of eltoprazine, 1-(3 trifluoromethylphenyl)piperazine hydrochloride and 8-hydroxy-2-(di-npropylamino)tetralin on resident intruder aggression in the rat. European Journal of Pharmacology. 1992;**212**: 295-298. DOI: 10.1016/0014-2999(92) 90348-8

[100] Mos J, Olivier B, Poth M, Van Oorschot R, Van Aken H. The effects of dorsal raphe administration of eltoprazine, TFMPP and 8-OH-DPAT on resident intruder aggression in the rat. European Journal of Pharmacology. 1993;**238**:411-415. DOI: 10.1016/ 0014-2999(93)90877-k

[101] Coccaro EF, Fanning JR, Phan KL, Lee R. Serotonin and impulsive aggression. CNS Spectrums. 2015;**20**: 295-302. DOI: 10.1017/ S1092852915000310

[102] Rosell DR, Siever LJ. The neurobiology of aggression and violence. CNS Spectrums. 2015;**20**: 254-279. DOI: 10.1017/ S109285291500019X

[103] Verhoeven WMA, Tuinier S. Serenics: Anti-aggression drugs throughout history. Clinical Neuropsychiatry. 2007;**4**:135-143

## **Chapter 6**
