What constitutes sole and joint custody is not always easy to figure out. Ultimately, it is very difficult to deviate from joint physical custody, but it can be done. This is only about physical custody. Legal custody is a completely different discussion with other factors to be considered.