Automate an action that depends on interface changing? [Windows]

Hello!
There's a proprietary software called Microsoft Teams. A client(not mine, I am not taking orders yet) has to attend lectures through Teams.
But they'd rather spend their time elsewhere, so they want to automate the joining part without actually being there.

So the question is. Which way would you go about doing this? Is it possible to programmaticaly detect where the button is based on its text or color? How can we detect that the interface changed in the first place?
Would it be possible to automate if the button just appeared on a random position on the screen?

If you have automated a desktop app, what was the solution you used?

Just to answer my own question, apparently you can do that not by coordinates, but by using the picture of a button. Something to research further.

One possible approach is to use a tool like Microsoft's UI Automation framework, which allows you to programmatically interact with the user interface of Windows applications. With this framework, you could identify the relevant controls on the Teams interface, such as the Join button, and simulate clicks or keystrokes to interact with them.

uxx0utt said:

Just to answer my own question, apparently you can do that not by coordinates, but by using the picture of a button. Something to research further.

Click to expand...

Microsoft Power Automate has this feature
It can detect based on pixels or pictures that you provided.
And then it will do pre-determined actions that you set
so if your inbox pop sup "meeting started 0 minutes ago" next action -> Press Join -> Join as mute -> then wait for "meeting closed" then close meeting then loop
no real programming knowledge is needed for it.