The monodromy groups of Appell's hypergeometric functions $F_1$ in two variables are sometimes discontinuous, but in general are not arithmetically defined ([DM],[M]). However we associate to them families of abelian varieties which give natural modular embeddings of the monodromy groups into arithmetic groups. We describe these embeddings and sketch some applications to automorphic functions and transcendence questions.