Dependency Refactor & Organization

[philipc2]

There have been many concerns brought up by our users that we could better organize our dependencies, including handling optional dependencies in a more elegant manner.

[philipc2]

@kafitzgerald