Commercial real estate investors are overlooking the chance to boost returns by more than one-third by capturing short- and medium-term opportunities and embedding greater optionality into their decision making.
Our analysis shows that by not adopting this approach, commercial real estate investors are missing out on an estimated $200 billion of value worldwide each year. We call this “dark value” because, like dark matter in physics, its effects can be seen in lost opportunities, but it can’t be measured directly. Fortunately, investors can turn to AI-enabled tools and learn from commodity traders how to tap this dark value by applying greater flexibility and developing strategies that take advantage of existing industry constraints.
The Long-Term Game
The commercial real estate sector is characterized by multiple areas of friction: high transaction costs, complex regulations, asset heterogeneity, and information asymmetry slow the pace of transactions, lead to low market liquidity, and favor a limited pool of players.
Most investors view commercial real estate as a long-term portfolio allocation that offers a steady income yield, diversification from public markets, and inflation protection, with valuations typically conducted annually. Even in the US, which has a dynamic property market, 54% of investors on average have held assets for over five years since 2000. And in other regions, the proportion is significantly higher. (See Exhibit 1.) About 60% of all capital invested in real estate globally is allocated on the basis of “core” or “core-plus” investment strategies, which target a stable and predictable long-term income.
This long-term approach should not be mistaken for a behavioral failure. For many institutional investors, extended hold periods are rational from a risk-reward perspective and aligned with mandates focused on yield, current income, and portfolio diversification rather than maximizing gains. Still, this model can leave shorter-term optimization opportunities within hold periods less fully explored.
The Dark Value Potential
However, several factors are causing the landscape to shift from the “buy-and-hold” business model. AI and machine learning have made it far cheaper to create tools that identify arbitrage and other value creation opportunities, turning the market data that property players possess into the key differentiating factor in dark value capture. The sector has also seen an influx of private equity investors willing to shake things up. In addition, leading players are realizing that the industry’s many friction points lend themselves to generating dark value.
For these reasons, commercial real estate was ranked as the sector with the greatest potential for value creation via short- and medium-term optimization, according to a recent BCG survey of approximately 500 C-suite executives across industries worldwide.
We’ve found that most players are currently still at zero or step one on a value capture ladder, meaning they allocate capital for the long term and revalue assets on a yearly basis. (See Exhibit 2.) By applying monthly valuations and using AI to scan for opportunities, a few leading players have achieved or are close to step three (systematic dark value capture) and can progress further. Nevertheless, players that are less well suited to capturing dark value—because, for instance, they use an open-ended investment structure—can still tap significant benefits by doing things like increasing their focus on optionality and arbitrage in step two (opportunistic dark value capture).
The Importance of Acting Systematically
Some commercial real estate investors already use optimization strategies similar to those of commodity traders and hedge funds. For instance, they may “flip” an asset for a quick profit. But most use these strategies sporadically and lack the operating model to deploy them systematically. When asked about optimization strategies, 67% of executives from the commercial real estate sector said they used them only occasionally or not at all, the BCG survey found. (See Exhibit 3.)
They are missing out on a significant prize. By applying all optimization levers, our analysis indicates that commercial real estate players can increase their return on assets by 3 to 5 percentage points per annum. Achieving the upper end of this range requires substantial changes to players’ operating models and processes. Consequently, a more realistic target, even for players well-suited to dark value capture, is a per-annum uplift of 3 to 4 percentage points, which is in line with a typical return for a commodity trader. Given that commercial real estate returns averaged around 9% from 1978 to 2022 (according to figures from the US National Council of Real Estate Investment Fiduciaries), an uplift of this magnitude would represent an increase in returns of around one-third.
Actions to Capture Dark Value
We have identified six areas that can drive dark value for commercial real estate investors and other players, in a similar fashion to traders. These drivers apply to all industries but differ in detail from one to the next.
- Geography. The same asset type will perform differently from one regional market to the next due to local demand, pricing power, and competitive dynamics. These differences create geography-based arbitrage opportunities for investors that can identify and allocate capital to markets containing mispriced or outperforming assets.
- Quality. It is the nature of commercial real estate that every asset is unique, with a differing tenant mix, lease terms, amenities, and risk profile. This heterogeneity complicates comparisons between assets and makes valuations more difficult. But for those with superior asset-level insights, it is a source of valuable quality-based arbitrage opportunities.
- Time. Due to long-term lease arrangements, revenues from property assets are generally locked in for a considerable period. This situation limits both supply flexibility and short-term pricing adjustments. However, operators that embed optionality into their lease structures (using short-term or optimized leases) and anticipate market cycles can capture time-based arbitrage opportunities. It is important to note that long-term leases can provide predictable, financeable income, so shorter or more flexible terms should be evaluated selectively.
- Industry Reconfigurability. Due to high transaction costs, substantial regulations, long development cycles, and information asymmetry, commercial real estate players are slow to respond to supply and demand signals. This weak reconfigurability increases asset price volatility during a short-term shock, such as an interest rate hike, because players can’t easily turn off supply. But it also creates profit opportunities for players that can reposition capital or assets faster than the market.
- Immediate Buffers. Players that keep either space or capital in reserve as a buffer can capture significant value. For example, in a scenario in which demand for data centers grows but over 90% of under-construction capacity is already committed, players that can meet demand are in a strong position. Similarly, players that have built up abundant “dry powder” capital are well-placed to acquire distressed assets at a steep discount.
- Capital Flows. The sector typically has strong access to funding, especially for new and high-demand assets such as data centers. While capital is generally available in commercial real estate, companies can still get ahead of rivals by diversifying their funding base or using fractional asset ownership in the secondary market to improve liquidity so that they can move more quickly in fast-growing segments.
There are multiple levers that commercial real estate investors and other players can use to capture dark value across these six areas. (See Exhibit 4.)
Building an Operating Model for Dark Value Capture
Even those investors that are well-placed for dark value capture currently lack the capabilities and operating model to do so effectively. Here are three steps that we believe will lay the foundations for a successful strategy.
- Apply the right tools. Many investors possess a wealth of information about asset values and income streams pooled from external sources and their own proprietary databases. With AI lowering development costs for tools, this information is becoming increasingly important as a source of competitive advantage. However, investors need to apply analytical tools that provide them with a real-time view of evolving market dynamics and enable them to take the right actions. By using mark-to-market tools that accurately reflect current asset values, investors can identify dark value opportunities as they emerge. Supply and demand models and market sensing tools (including social media monitoring) are also important to assess and anticipate market conditions and sentiment. Yield arbitrage tools provide valuable insights into differences in yield between regions and asset classes, while portfolio analytics enables investors to maintain a low correlation between the assets in their portfolios and reduce risk.
- Change the culture. The industry’s slow pace and conservative mindset are major obstacles to dark value capture. To effectively pursue short- and medium-term opportunities, players must embrace a different attitude to risk and empower employees with the authority to act quickly. Organizations should move from avoiding risk to managing it, using real-time monitoring of positions, value at risk, and market shifts to take calculated risks rather than forgoing them. An important part of this cultural shift is introducing new performance metrics and incentives. Performance metrics ought to measure profit generated across multiple time horizons, while incentives should reward innovation rather than simply achieving long-term targets.
- Transform governance. Governance structures among investors are too rigid to accommodate the dynamic processes involved in dark value capture. Decision making is often centralized and hierarchical, with authority concentrated among a few key individuals. This slows down reactions and stifles initiative. To capture dark value effectively, decision rights need to move closer to the front line. Each dark value team should operate as its own profit center and have the autonomy to act on market signals and grasp opportunities as they arise.
Not all of these steps will work for all investors. While some players already have advanced decision-making tools, such as mark-to-market systems and supply and demand models, others still rely on simple spreadsheets for their decision making. For these less sophisticated players, developing a complete dark value approach will likely be extremely challenging, if not impossible. Instead, they should select those operating model elements that align with their capabilities and ambition level.
Meanwhile, sophisticated investors seeking to shift to a more dark value–centric model can take a page from the trader’s playbook and create a parallel play: a unit separate from the main organization that has tools, processes, and governance approaches that are better suited to short- and medium-term optimization.
Dark value represents a huge opportunity for commercial real estate. While the sector historically has been slow to progress from a conservative buy-and-hold business model, the situation is starting to change. With AI reducing technology costs, now is the time to pursue dark value capture. By putting in place the right capabilities, players can turn flexibility into profit.