Zhang, Hao;
              
      
            
                Chen, Boli;
              
      
            
                Lei, Nuo;
              
      
            
                Li, Bingbing;
              
      
            
                Li, Rulong;
              
      
            
                Wang, Zhi;
              
      
        
        
  
(2023)
  Integrated Thermal and Energy Management of Connected Hybrid Electric Vehicles Using Deep Reinforcement Learning.
IEEE Transactions on Transportation Electrification
      
    
    
    
         10.1109/tte.2023.3309396.
   (In press).
  
      
    
  
Preview  | 
            
              
Text
 Chen_IEEE_TTE.pdf Download (2MB) | Preview  | 
          
Abstract
The climate-adaptive energy management system holds promising potential for harnessing the concealed energy-saving capabilities of connected plug-in hybrid electric vehicles. This research focuses on exploring the synergistic effects of artificial intelligence control and traffic preview to enhance the performance of the energy management system (EMS). A high-fidelity model of a multi-mode connected PHEV is calibrated using experimental data as a foundation. Subsequently, a model-free multistate deep reinforcement learning (DRL) algorithm is proposed to develop the integrated thermal and energy management (ITEM) system, incorporating features of engine smart warm-up and engine-assisted heating for cold climate conditions. The optimality and adaptability of the proposed system is evaluated through both offline tests and online hardware-in-the-loop tests, encompassing a homologation driving cycle and a real-world driving cycle in China with real-time traffic data. The results demonstrate that ITEM achieves a close to dynamic programming fuel economy performance with a margin of 93.7%, while reducing fuel consumption ranging from 2.2% to 9.6% as ambient temperature decreases from 15°C to -15°C in comparison to state-of-the-art DRL-based EMS solutions.
| Type: | Article | 
|---|---|
| Title: | Integrated Thermal and Energy Management of Connected Hybrid Electric Vehicles Using Deep Reinforcement Learning | 
| Open access status: | An open access version is available from UCL Discovery | 
| DOI: | 10.1109/tte.2023.3309396 | 
| Publisher version: | https://doi.org/10.1109/tte.2023.3309396 | 
| Language: | English | 
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. | 
| Keywords: | Climate-adaptive, plug-in hybrid electric vehicles, deep reinforcement learning, integrated thermal and energy management, optimality, adaptability | 
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng  | 
        
| URI: | https://discovery.ucl.ac.uk/id/eprint/10176008 | 
Archive Staff Only
![]()  | 
        View Item | 
                      
