For those of you working with Rich Text / CMS and unable to find how to access All Links, this is how you should do it:
Go to Settings on the right panel, find Rich Text Block Settings, and disconnect your CMS property from the block
The styling settings in the box you now see in the designer is what is applied to your CMS items. You can select individual items here and change the styling as needed. When you are done, to reconnect the property find the small purple dot on the top left of where you previously disconnected the property
Select the CMS field name and it will repopulate the content into the rich text block with the updated styling applied.