Wording like “I don’t have time for this” or “I don’t care” or “Get to the point” are dismissive and show a lack of empathy.
It’s saying that you just don’t care about them or the things that they care about.
Instead, be patient and allow them their time.
If you really are pressed for time, you might say: “Please take all the time you need in the next [30 seconds, 1 minute, 2 minutes] to share the important details of the situation.” Or, “I’m so interested in what you’re saying and due to our limited time together, please share the most important details about the situation.”
If this happens consistently, it might be worthwhile to have a discussion about how you have conversations and discuss how you might help them maximize your conversation time together.