The development of the CHARMM lipid force field (FF) can be traced back to the early 1990s with its current version denoted CHARMM36 (C36). The parametrization of C36 utilized high-level quantum mechanical data and free energy calculations of model compounds before parameters were manually adjusted to yield agreement with experimental properties of lipid bilayers. While such manual fine-tuning of FF parameters is based on intuition and trial-and-error, automated methods can identify beneficial modifications of the parameters via their sensitivities and thereby guide the optimization process. This work introduces a semi-automated approach to reparametrize the CHARMM lipid FF with consistent inclusion of long-range dispersion through the Lennard-Jones particle-mesh Ewald (LJ-PME) approach. The optimization method is based on thermodynamic reweighting with regularization with respect to the C36 set. Two independent optimizations with different topology restrictions are presented. Targets of the optimizations are primarily liquid crystalline phase properties of lipid bilayers and the compression isotherm of monolayers. Pair correlation functions between water and lipid functional groups in aqueous solution are also included to address headgroup hydration. While the physics of the reweighting strategy itself is well-understood, applying it to heterogeneous, complex anisotropic systems poses additional challenges. These were overcome through careful selection of target properties and reweighting settings allowing for the successful incorporation of the explicit treatment of long-range dispersion, and we denote the newly optimized lipid force field as C36/LJ-PME. The current implementation of the optimization protocol will facilitate the future development of the CHARMM and related lipid force fields.