how scary are the elves really?

imagine if our world was like dungeon meshi. realistically how scary would be the elves? i mean we're talking about living in a society where some other intelligent species live like 5 times longer than us and an elf grandma in 2025 would be older than the usa, they would've seen the creation of the qing dynasty in china and her parents would have been around during genghis khan's era. so, would we (tall-men) fear the elves? would we constantly be walking on eggshells around them? would they just be extremely dominant in high society?