Rational design of disordered molecular aggregates and solids for optoelectronic applications relies on our ability to predict the properties of such materials using theoretical and computational methods. However, large molecular systems where disorder is too significant to be considered in the perturbative limit cannot be described using either first principles quantum chemistry or band theory. Multiscale modeling is a promising approach to understanding and optimizing the optoelectronic properties of such systems. It uses first-principles quantum chemical methods to calculate the properties of individual molecules, then constructs model Hamiltonians of molecular aggregates or bulk materials based on these calculations. In this paper, we present a protocol for constructing a tight-binding Hamiltonian that represents the excited states of a molecular material in the basis of Frenckel excitons: electron-hole pairs that are localized on individual molecules that make up the material. The Hamiltonian parametrization proposed here accounts for excitonic couplings between molecules, as well as for electrostatic polarization of the electron density on a molecule by the charge distribution on surrounding molecules. Such model Hamiltonians can be used to calculate optical absorption spectra and other optoelectronic properties of molecular aggregates and solids.