The Buddha got a lot of stuff right (yeah, he got a lot wrong too....I know). He did recognize that suffering in our lives was inevitable, and that we are way too attached to things. Learning how to let go of "stuff" in our lives - even emotional "stuff" - is a good way to avoid a lot of unnecessary suffering. I don't believe we can get rid of all attachments - we humans are meant to be in relationship with each other, and it hurts when we lose those relationships, whether through a break-up, a relocation, a misunderstanding or death. We shouldn't abandon each other just because of this, though, and that's where Buddha goes a bit far.
Speak or act with an impure mind and trouble will follow you.
This is just the sort of thing that Buddha says that I can agree with, and it doesn't in any way conflict with my Catholic faith. Thankfully, the Buddha never set himself up as a god, to be worshiped. He knew he was just a guy looking for answers, and he thought he'd found some. I admire that: the humility he had, the longing for answers for hard questions, the simplicity of his message.
It's what I like about Buddha.