We consider a general class of optimization problems in financial markets with incomplete information and transaction costs. Under a no-arbitrage condition strictly weaker than the existence of a martingale measure, and when asset prices are quasi-left-continuous processes, we show the existence of optimal strategies. Applications include maximization of expected utility, minimization of coherent risk measures and hedging of contingent claims.