Although the terms "rare diseases" (RD) and "orphan diseases" (OD) are often used interchangeably, specific nuances in definitions should be noted to avoid misconception. RD are characterized by a low prevalence within the population, whereas OD are those inadequately recognized or even neglected by the medical community and drug companies. Despite their rarity, as our ability on discovering novel clinical phenotypes and improving diagnostic tools expand, RD will continue posing a real challenge for rheumatologists. Over the last decade, there has been a growing interest on elucidating mechanisms of rare autoimmune and autoinflammatory rheumatic diseases, allowing a better understanding of the role played by immune dysregulation on granulomatous, histiocytic, and hypereosinophilic disorders, just to name a few. This initiative enabled the rise of innovative targeted therapies for rheumatic RD. In this review, we explore the state-of-the art of rare RD and the critical role played by rheumatologists in healthcare. We also describe the challenges rheumatologists may face in the coming decades.