I am putting in an application for a position in Germany, and it asks for references to be attached
What is the exact wording? Having LORs attached would be unusual, as you suggest. Open LORs are very uncommon in Germany (I disagree with puffin, may be due to field, though). Asking for references (but not "letters") usually means to put the contact info of your references (LOR writers). They will be contacted directly then.
If they ask you to upload the letters, you can still ask your LOR writers to send the letters directly. Even if not requested "closed" letters will still be more valid. Maybe it's a confusing English version of an ad. If there is any secretary you can call to clarify, do so.
Yet, LORs won't mean very much as the U will get their own outside "reviewers" anyhow. So don't worry about the whole LOR thing too much. The importance is not comparable with US applications.
If you send your CV as pdf, you may (but don't have to) include a photo on the first page of that. It is OK and common to include a photo in a German application, but it is not a must.
Even if it's not TT, if the university likes you, they may be able to convert a non-TT position into a tenured position after some years.