Wealthy individuals, including so-called accredited investors, have poured billions of dollars into private-equity funds and other alternative investments in recent years. Now, with more firms that trade in older swathes of private assets, some of those investors are placing bets.