You can add or remove yourself from a group by clicking on the following symbol:

If the symbol is grey, then you can click to join. If the symbol is green, it means that you are already a member of that group