首页 > 其他分享 >android AccessibilityService合法合规采集大众点评app商店商品详情(2024-09-02)

android AccessibilityService合法合规采集大众点评app商店商品详情(2024-09-02)

时间：2024-09-02 20:52:34浏览次数：12  
标签：02 count return String commodity app 09 shop null

免责任声明: 任何可操作性的内容与本人无关,文章内容仅供参考学习，如有侵权损害贵公司利益，请联系作者，会立刻马上进行删除。

android AccessibilityService合法合规采集大众点评app商店商品详情(2024-09-02)_数据采集


一、原理介绍

1、打开大众点评app商店

    public void open_shop(Context context,String shop_id)
    {
        String url="dianping://gcshopshell?shopuuid="+shop_id;
        scroll_count=0;
        Uri uri = Uri.parse(url); //
        Intent intent =new Intent(Intent.ACTION_VIEW,uri);;
        intent.addFlags(Intent.FLAG_ACTIVITY_NEW_TASK);
        context.startActivity(intent);
    }

2、采集如下字段：

    public class Commodity{
        public int id;
        public String title;        //商品标题
        public String price;      //售价
        public String market_price;  //市场价
        public String sales;            //年销量
        public String shop_id;        //商店id
        public String shop_index;
        public int count;
    }

3、 保存数据为Csv文件


            Csv csv1=Csv.getInstance(context);
            boolean bres=csv1.save_commodities(commodities);
            if(bres==false){
                fb.set_show("保存数据失败！请检查有没有数据存储权限！");
                return;
            }

4、滚动屏幕

private void performScroll(AccessibilityNodeInfo rootNode){
        if(mCurrentUI.startsWith("com.dianping.shopshell")){
            AccessibilityNodeInfo scrollNode=AccessibilityHelper.findNodeInfosById(rootNode,"com.dianping.v1:id/pagecontainer_recyclerview",0);
            if(scrollNode!=null) {
                if (scroll_count < 10) {
                    AccessibilityHelper.performScrollForward(scrollNode);
                    AccessibilityNodeInfo firstNode=AccessibilityHelper.findNodeInfoByTextAllMatched(rootNode,"抢购");
                    if(firstNode==null)scroll_count=10;
                }
                else {
                    AccessibilityHelper.performScrollBackward(scrollNode);
                    AccessibilityNodeInfo firstNode=AccessibilityHelper.findNodeInfoByTextAllMatched(rootNode,"封面");
                    if(firstNode!=null)scroll_count=0;
                }
                scroll_count += 1;
                if (scroll_count > 20) {
                    scroll_count = 0;
                }
            }

5、采集数据

private Commodity get_commodity(AccessibilityNodeInfo buyNode){
        try{
            AccessibilityNodeInfo parent=buyNode.getParent();
            if(parent==null)return null;
            parent=parent.getParent();
            if(parent==null)return null;
            int price_count=0;
            Commodity commodity=new Commodity();
            for (int i = 0; i < parent.getChildCount(); i++) {
                AccessibilityNodeInfo child=parent.getChild(i);
                if(child!=null&&child.getText()!=null){
                    String text=child.getText().toString();
                    text=text.replaceAll(",","[comma]");
                    commodity.shop_id=shop_id;
                    commodity.shop_index=String.valueOf(csv.shop_index);
                    commodity.count=commodity_count;
                    if(i==0){
                        //if(isInCommodities(text))return null;
                        commodity.title=text;
                    }
                    if(text.startsWith("年售"))commodity.sales=text;
                    if(text.startsWith("全国爆卖"))commodity.sales=text;
                    if(text.startsWith("¥")){
                        if(price_count==0)
                            commodity.price=text;
                        else
                        if(price_count==1)
                            commodity.market_price=text;
                        price_count+=1;
                    }

                }
            }
            if(isInCommodities(commodity))return null;
            return commodity;
        }catch (Exception e){
            MyLog.e(e);
            return null;
        }
    }
    private boolean isInCommodities(String title){
        for (Commodity commodity:commodities){
            if(title.equals(commodity.title))return true;
        }
        return false;
    }

6、获取商品数量并点击更多，展开商品信息

 private void performMoreClick(AccessibilityNodeInfo rootNode){
        if(commodity_count>0)return;
        AccessibilityNodeInfo moreNode=AccessibilityHelper.findNodeInfosByText(rootNode,"个团购",0);
        if(moreNode!=null) {
            String text=moreNode.getText().toString();
            if(text.startsWith("更多")){
                AccessibilityNodeInfo parent=moreNode.getParent();
                if(parent==null)return;
                if(parent.getClassName().toString().equals("android.widget.LinearLayout")){
                    MyLog.i("找到："+text);
                    int more=Funcs.getDigital(text);
                    if(more>0)commodity_count=more+5;
                    show_count();
                    AccessibilityHelper.performClick(moreNode);
                }
            }
            return;
        }
        moreNode=AccessibilityHelper.findNodeInfosByText(rootNode,"个商品",0);
        if(moreNode!=null) {
            String text=moreNode.getText().toString();
            if(text.indexOf("更多")>0){
                String say="非美容院商店...跳过";
                FloatWindowButton fb=FloatWindowButton.getInstance(context);
                fb.set_show(say);
                Csv csv1=Csv.getInstance(context);
                boolean bres=csv1.save_no_shop_id(shop_id,String.valueOf(csv1.shop_index));
                if(bres==false){
                    fb.set_show("保存数据失败！请检查有没有数据存储权限！");
                    return;
                }
                open_next_shop_prepare(Config.interval,false);
            }
            return;
        }
    }

二、完整源代码

package accessibility.app;
import accessibility.AccessibilityFindByText;
import accessibility.AccessibilityHelper;
import accessibility.BaseAccessibilityJob;
import accessibility.AccService;
import floatwindow.FloatWindowButton;
import utils.Config;
import utils.Csv;
import utils.Funcs;
import utils.MyLog;

import android.content.Context;
import android.content.Intent;
import android.graphics.Point;
import android.net.Uri;
import android.os.Handler;
import android.util.Log;
import android.view.accessibility.AccessibilityEvent;
import android.view.accessibility.AccessibilityNodeInfo;
import android.widget.Toast;

import com.dp.jp.MainActivity;

import java.util.ArrayList;
import java.util.List;

public class ShopInfoJob  extends BaseAccessibilityJob{
    public static final int STAT_NONE=0;
    public static final int STAT_WORKING=1;
    public static final int STAT_WAITING=2;
    public static int state=0;
    private static ShopInfoJob current;
    private utils.Csv csv;
    private int scroll_count=0;

    public String CurrentUI=null;
    public String shop_id=null;
    private boolean is_alarm=false;
    //--------------------------------------------------------------------------
    public List<Commodity> commodities=new ArrayList<Commodity>() ;
    public boolean isBusy=false;
    private int commodity_count=0;
    private ShopInfoJob() {
        //super(new String[]{Config.PKG_IM_TOKEN,Config.PKG_HUOBI,Config.PKG_BTD});
        super(new String[]{"com.dianping.v1"});
        //super(null);技术支持：metabycf or byc6352
        csv= Csv.getInstance(context);
    }
    public static synchronized ShopInfoJob getInstance() {
        if(current == null) {
            current = new ShopInfoJob();
        }
        return current;
    }
    @Override
    public void onCreateJob(AccService service) {
        super.onCreateJob(service);
        EventStart();


    }
    @Override
    public void onStopJob() {
        super.onStopJob();

    }
    /*
     * (刷新处理流程)
     * @see accessbility.AccessbilityJob#onWorking()
     */
    @Override
    public void onWorking(){
        FloatWindowButton fb=FloatWindowButton.getInstance(context);
        String say="正在执行任务...";
        if(commodity_count>0&&commodities.size()>=commodity_count){

            say="采集完成...";
            fb.set_show(say);
            Csv csv1=Csv.getInstance(context);
            boolean bres=csv1.save_commodities(commodities);
            if(bres==false){
                fb.set_show("保存数据失败！请检查有没有数据存储权限！");
                return;
            }
            AccessibilityHelper.performBack(service);
            Funcs.sleep(2);

            open_next_shop_prepare(Config.interval,false);
            return;
        }
        AccessibilityNodeInfo rootNode = service.getRootInActiveWindow();
        if (rootNode == null) return;

        fb.set_show(say);
        //com.dianping.shopshell.GCShopInfoActivity
        if(rootNode.getPackageName().toString().equals("com.dianping.v1")){
            if(mCurrentUI.startsWith("com.dianping.shopshell.")) {
                performMoreClick(rootNode);
                performScroll(rootNode);

            }
       }


    }
    @Override
    public void onReceiveJob(AccessibilityEvent event) {
        super.onReceiveJob(event);
        if(!mIsEventWorking)return;
        if(!mIsTargetPackageName)return;
        CurrentUI=mCurrentUI;
        if (event.getEventType() == AccessibilityEvent.TYPE_WINDOW_STATE_CHANGED)
        {
            MyLog.i("mCurrentUI="+mCurrentUI);
            if(mCurrentUI.startsWith("com.dianping.shopshell.")){
                if(state==STAT_WORKING) {

                }
                if(is_alarm)
                    Funcs.alarm(context,false);
            }
            if(mCurrentUI.startsWith("android.app.Dialog")){
                if(Config.auto_close_verify){
                    AccessibilityNodeInfo rootNode=event.getSource();
                    if(rootNode==null)return;
                    //close_verify_btn(rootNode);
                }else {
                    Funcs.alarm(context,true);
                    is_alarm=true;
                }

            }
            if(mCurrentUI.startsWith("com.meituan.android.yoda.activity.YodaConfirmActivity")){
                if(Config.auto_close_verify){
                    AccessibilityNodeInfo rootNode=event.getSource();
                    if(rootNode==null)return;
                    //close_verify_back(rootNode);
                }else {
                    Funcs.alarm(context,true);
                    is_alarm=true;
                }

            }


        }
        if (event.getEventType() == AccessibilityEvent.TYPE_WINDOW_CONTENT_CHANGED)
        {
            if(commodity_count>0&&commodity_count==commodities.size())return;
            if(mCurrentUI.startsWith("com.dianping.shopshell.")){
                if(state==STAT_WORKING) {
                    AccessibilityNodeInfo rootNode=event.getSource();
                    if(rootNode==null)return;
                    pluck_from_shop(rootNode);
                    TimeStart();
                    performMoreClick(rootNode);
                }
            }

        }

    }
    //---------------------------------------------------------------------
    //"dianping://gcshopshell?shopuuid=H44paDfKZflcSGHd"
    public void open_shop(Context context,String shop_id)
    {
        String url="dianping://gcshopshell?shopuuid="+shop_id;
        scroll_count=0;
        Uri uri = Uri.parse(url); //
        Intent intent =new Intent(Intent.ACTION_VIEW,uri);;
        intent.addFlags(Intent.FLAG_ACTIVITY_NEW_TASK);
        context.startActivity(intent);
    }
    /*
    1.浮动窗口：下一个
    2.working.over
    3.主窗口：继续
    4.accservice open
     */
    public void open_next_shop_prepare(int delay,boolean cur){
        if(runnableStart!=null)return;

        state=STAT_WAITING;
        //et_cur_id.setText(String.valueOf(csv1.commodities_index));
        runnableStart = new Runnable() {
            @Override
            public void run() {
                try {
                    Csv csv1=Csv.getInstance(context);
                    if(cur)
                        shop_id=csv1.get_shop_id();
                    else
                        shop_id=csv1.get_next_shop_id();
                    FloatWindowButton fb=FloatWindowButton.getInstance(context);
                    fb.ShowFloatWindow();
                    if(csv1.shop_index>Config.end_id||csv1.shop_index>csv1.get_shop_total_count()||shop_id.equals("")){
                        String say="已完成任务";
                        fb.set_show(say);
                        runnableStart=null;
                        return;
                    }
                    state=STAT_WORKING;
                    String say="开始执行任务...";
                    fb.set_show(say);
                    fb.set_commodity_count_show(String.valueOf(csv1.shop_index));
                    open_shop(context,shop_id);
                    commodities.clear();
                    commodity_count=0;
                    runnableStart=null;

                }catch (Exception e){
                    MyLog.e(e.getMessage().toString());
                }

            }
        };
        handler.postDelayed(runnableStart, delay);
    }

    //private boolean pluck_start=false;
    //private int pluck_count=0;
    //private Commodity commodity=null;

    private void pluck_from_shop(AccessibilityNodeInfo rootNode){
        try{
            if(mCurrentUI.startsWith("com.dianping.shopshell.")){
                if(isBusy)return;
                isBusy=true;
                try{
                    //com.dianping.v1:id/pagecontainer_recyclerview
                    //AccessibilityNodeInfo pagecontainerNode=AccessibilityHelper.findNodeInfosById(rootNode,"com.dianping.v1:id/pagecontainer_recyclerview",0);
                    //if(pagecontainerNode!=null){
                        List<AccessibilityNodeInfo>  buyNodes=AccessibilityHelper.findNodeInfosByTextAllMatched(rootNode,"抢购");
                        if(buyNodes==null||buyNodes.size()==0)return;
                        for (AccessibilityNodeInfo buyNode:buyNodes){
                            Commodity commodity=get_commodity(buyNode) ;
                            if(commodity!=null)commodities.add(commodity);
                        }
                        show_count();
                    //}
                }catch (Exception e){
                    MyLog.e(e.getMessage().toString());
                    return ;
                }finally {
                    isBusy=false;
                }
            }
        }catch (Exception e){
            MyLog.e(e.getMessage().toString());

        }
    }


    private void performScroll(AccessibilityNodeInfo rootNode){
        if(mCurrentUI.startsWith("com.dianping.shopshell")){
            AccessibilityNodeInfo scrollNode=AccessibilityHelper.findNodeInfosById(rootNode,"com.dianping.v1:id/pagecontainer_recyclerview",0);
            if(scrollNode!=null) {
                if (scroll_count < 10) {
                    AccessibilityHelper.performScrollForward(scrollNode);
                    AccessibilityNodeInfo firstNode=AccessibilityHelper.findNodeInfoByTextAllMatched(rootNode,"抢购");
                    if(firstNode==null)scroll_count=10;
                }
                else {
                    AccessibilityHelper.performScrollBackward(scrollNode);
                    AccessibilityNodeInfo firstNode=AccessibilityHelper.findNodeInfoByTextAllMatched(rootNode,"封面");
                    if(firstNode!=null)scroll_count=0;
                }
                scroll_count += 1;
                if (scroll_count > 20) {
                    scroll_count = 0;
                }
            }
            //AccessibilityNodeInfo no_moreNode=AccessibilityHelper.findNodeInfosByText(rootNode,"收起",0);
            //if(no_moreNode!=null&&no_moreNode.getText()!=null&&no_moreNode.getText().toString().startsWith("收起")) scroll_count=10;

        }

    }





    private Commodity get_commodity(AccessibilityNodeInfo buyNode){
        try{
            AccessibilityNodeInfo parent=buyNode.getParent();
            if(parent==null)return null;
            parent=parent.getParent();
            if(parent==null)return null;
            int price_count=0;
            Commodity commodity=new Commodity();
            for (int i = 0; i < parent.getChildCount(); i++) {
                AccessibilityNodeInfo child=parent.getChild(i);
                if(child!=null&&child.getText()!=null){
                    String text=child.getText().toString();
                    text=text.replaceAll(",","[comma]");
                    commodity.shop_id=shop_id;
                    commodity.shop_index=String.valueOf(csv.shop_index);
                    commodity.count=commodity_count;
                    if(i==0){
                        //if(isInCommodities(text))return null;
                        commodity.title=text;
                    }
                    if(text.startsWith("年售"))commodity.sales=text;
                    if(text.startsWith("全国爆卖"))commodity.sales=text;
                    if(text.startsWith("¥")){
                        if(price_count==0)
                            commodity.price=text;
                        else
                        if(price_count==1)
                            commodity.market_price=text;
                        price_count+=1;
                    }

                }
            }
            if(isInCommodities(commodity))return null;
            return commodity;
        }catch (Exception e){
            MyLog.e(e);
            return null;
        }
    }
    private boolean isInCommodities(String title){
        for (Commodity commodity:commodities){
            if(title.equals(commodity.title))return true;
        }
        return false;
    }
    private boolean isInCommodities(Commodity commodity_new){
        try {
            for (Commodity commodity:commodities){
                if(Funcs.isEqua(commodity_new.title,commodity.title)&&Funcs.isEqua(commodity_new.price,commodity.price)&&Funcs.isEqua(commodity_new.sales,commodity.sales))return true;
            }
            return false;
        }catch (Exception e){
            MyLog.e(e);
            return false;
        }
    }
    private void performMoreClick(AccessibilityNodeInfo rootNode){
        if(commodity_count>0)return;
        AccessibilityNodeInfo moreNode=AccessibilityHelper.findNodeInfosByText(rootNode,"个团购",0);
        if(moreNode!=null) {
            String text=moreNode.getText().toString();
            if(text.startsWith("更多")){
                AccessibilityNodeInfo parent=moreNode.getParent();
                if(parent==null)return;
                if(parent.getClassName().toString().equals("android.widget.LinearLayout")){
                    MyLog.i("找到："+text);
                    int more=Funcs.getDigital(text);
                    if(more>0)commodity_count=more+5;
                    show_count();
                    AccessibilityHelper.performClick(moreNode);
                }
            }
            return;
        }
        moreNode=AccessibilityHelper.findNodeInfosByText(rootNode,"个商品",0);
        if(moreNode!=null) {
            String text=moreNode.getText().toString();
            if(text.indexOf("更多")>0){
                String say="非美容院商店...跳过";
                FloatWindowButton fb=FloatWindowButton.getInstance(context);
                fb.set_show(say);
                Csv csv1=Csv.getInstance(context);
                boolean bres=csv1.save_no_shop_id(shop_id,String.valueOf(csv1.shop_index));
                if(bres==false){
                    fb.set_show("保存数据失败！请检查有没有数据存储权限！");
                    return;
                }
                open_next_shop_prepare(Config.interval,false);
            }
            return;
        }
    }
    private void show_count(){
        String say="";
        if(commodity_count==0)
            say="当前商店编号："+String.valueOf(csv.shop_index)+"已找到商品数："+String.valueOf(commodities.size());
        else
            say="当前商店编号："+String.valueOf(csv.shop_index)+"共有商品数："+String.valueOf(commodity_count)+"已找到商品数："+String.valueOf(commodities.size());
        FloatWindowButton.getInstance(context).set_commodity_count_show(say);
    }












    private Runnable runnableStart=null;
    private Handler handler = new Handler();









    public class Commodity{
        public int id;
        public String title;
        public String price;
        public String market_price;
        public String sales;
        public String shop_id;
        public String shop_index;
        public int count;
    }

}


技术支持：


UVHvvJozOTg0ODg3MuW+ruS/oe+8mmJ5YzYzNTLmiJZtZXRhYnljZueUteaKpe+8mmJ5YzAx (base64解码)

标签：02,count,return,String,commodity,app,09,shop,null
From： https://blog.51cto.com/u_16113078/11900667

相关文章

  • [20240902]验证sql_idz.sh计算PLSQL代码块.txt
    [20240902]验证sql_idz.sh计算PLSQL代码块.txt--//测试验证sql_idz.sh计算PLSQL代码块是否正确.1.环境:SYS@book>@ver2==============================PORT_STRING                  :x86_64/Linux2.4.xxVERSION                     ......
  • [20240902]建立完善sql_idz.sh脚本.txt
    [20240902]建立完善sql_idz.sh脚本.txt--//增加hash_value的16进制显示采用大小写显示.$cat-v~/bin/sql_idz.sh#!/bin/bash#calcucatesql_textoffull_hash_value(16),hash_value(10),sql_id(32).#argv1sqlstatementorsqloftextfile#argv2flag:0=sqlstatement......
  • Kuasar 最前沿：KubeCon China 2024 精彩回顾
    8月21日-23日，由云原生计算基金会（CNCF）和Linux基金会联合主办的KubeCon+CloudNativeCon+OpenSourceSummit+Al_devChina2024大会在中国香港盛大召开。会上，多位Kuasar社区Maintainer分享了关于云原生容器运行时与大模型等领域前沿技术的案例实践与经验思考。KubeConChina......
  • C#/.NET/.NET Core技术前沿周刊 | 第 3 期（2024年8.26-8.31）
    前言C#/.NET/.NETCore技术前沿周刊，你的每周技术指南针！记录、追踪C#/.NET/.NETCore领域、生态的每周最新、最实用、最有价值的技术文章、社区动态、优质项目和学习资源等。让你时刻站在技术前沿，助力技术成长与视野拓宽。欢迎投稿，推荐或自荐优质文章/项目/学习资源等。每周一定期发......
  • android AccessibilityService合法合规增加小红书笔记曝光阅读量(2024-09-02)
    免责任声明:任何可操作性的内容与本人无关,文章内容仅供参考学习，如有侵权损害贵公司利益，请联系作者，会立刻马上进行删除。一、分析目前可增加曝光阅读流量渠道入口（完成）1.发现页打开小红书app选择顶部发现页（完成）2.搜索页打开小红书app点击右上角搜索，进入搜索结果页（完成）3.......
  • Autodesk 3DS Max v2025 激活版下载及安装教程
    前言Autodesk3dsMax是一款功能强大的3D建模和动画解决方案，游戏开发人员、视觉效果艺术家和平面设计师使用它来创建庞大的世界、令人惊叹的场景和引人入胜的虚拟现实(VR)体验。Autodesk3DSMAX是业界使用最广泛的3D建模和动画软件程序之一，它将为用户提供一系列新功能和工......
  • 2024.9.2 Python，用栈写每日温度，等差数列划分，子串所有可能性，等差数列划分，深度优先搜索
    1.每日温度给定一个整数数组temperatures，表示每天的温度，返回一个数组answer，其中answer[i]是指对于第i天，下一个更高温度出现在几天后。如果气温在这之后都不会升高，请在该位置用0来代替。示例1:输入:temperatures=[73,74,75,71,69,72,76,73]输出:[1,1,4,2,......
  • Autodesk Maya v2025 激活版下载及安装教程 (三维动画建模渲染)
    前言AutodeskMaya是一款用于三维动画、建模、仿真和渲染的软件。它是电影、电视、游戏和虚拟现实等领域中最流行的专业工具之一，被广泛用于制作复杂的特效和动画。功能完善，工作灵活，制作效率高，真实感强，是一款高端电影制作软件。它集成了最先进的动画和数字特效技术的别名和波前。......
  • 一图看懂天润云（2167.HK）2024年中期业绩
    ......
  • 中望CAD 专业 v2024 激活版下载与安装教程 (CAD三维制图)
    下载链接：https://pan.xunlei.com/s/VO5mffK30G6Mota3eRjZpGB5A1?pwd=4gyi#安装步骤1、下载解压后点击如下进行安装2、选择安装目录，最好不要安装在系统盘（C盘）3、安装中...耐心等待2-3分钟4、安装完先不要运行它，点击完成即可5、回到我们解压的文件夹里面，访问crack文件夹，把里......

赞助商

阅读排行

网站主页关于我们联系我们网站地图

本网站内容转载自其他媒体，侵权联系[admin##ips99.com]。

Copyright © 2020-2023 IPS99 版权所有 IPS99