The field of vision-based autonomous driving perception is currently facing challenges such as low efficiency in mapping images to three-dimensional space, insufficient modeling of long-range dependencies, and poor prediction accuracy for small objects in three-dimensional semantic occupancy prediction. This paper proposes the Cross-Dimensional Branch Occupancy Network (XDB-Occ), which significantly improves feature mapping efficiency and semantic understanding capabilities in complex scenes through an efficient image feature conversion mechanism and a dual-path Transformer architecture. The network adopts a multi-branch architecture design, leveraging its efficient image feature extraction capabilities to significantly enhance the effectiveness of feature mapping from images to high-dimensional space, thereby enabling more precise semantic occupancy prediction. Additionally, for the high computational cost of voxel feature computation in traditional BEV encoders, particularly the technical bottleneck where new modules struggle to effectively capture long-range dependencies due to computational resource constraints, this paper introduces the Efficient Pyramid Branch Fusion Module, which resolves the computational bottleneck of BEV encoders, significantly enhancing the model's ability to model long-range dependencies and complex scenes while reducing resource consumption. This paper achieves performance that significantly surpasses existing state-of-the-art methods on the SemanticKITTI and NuScenes datasets. XDB-Occ achieves a 1.16% improvement in mIoU on the SemanticKITTI dataset and a 1.6% improvement in mIoU on the NuScenes dataset.