一、单步sarsaimportmatplotlib.pyplotaspltimportnumpyasnpfromtqdmimporttqdm#tqdm是显示循环进度条的库classCliffWalkingEnv:def__init__(self,ncol,nrow):self.nrow=nrow#4self.ncol=ncol#12self.x=0#记录

一、策略迭代importcopyclassCliffWalkingEnv:"""悬崖漫步环境"""def__init__(self,ncol=12,nrow=4):self.ncol=ncol#定义网格世界的列self.nrow=nrow#定义网格世界的行#转移矩阵P[state][action]=[(p,next_state,

SubOnLButtonDown(ByValItem,ByValFlags,ByValx,ByValy)DimobjConnectionDimobjCommandDimobjRecordsetDimstrConnectionStringDimstrSQL,sSQLDimkWh,PFC,kW,A1,A2,A3,V1,V2,V3,Line_Name,Meter_ID,Line_IDDimstrkWh,strkW,strPFC,strA1,strA2,strA3,st