首页 > 其他分享 >springboot整合前端实现断点续传、大文件秒传以及多线程上传下载

springboot整合前端实现断点续传、大文件秒传以及多线程上传下载

时间：2023-11-16 18:23:58浏览次数：38  
标签：断点续传 springboot org fName upload file import new 多线程

前端，百度开源框架 webuploader
新建upload.html

webuploader官网地址： http://fex.baidu.com/webuploader/
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<title>webuploader</title>
</head>
<!--引入CSS-->
<link rel="stylesheet" type="text/css" href="webuploader.css">
<script src="jquery-1.11.1.js"></script>
<script src="webuploader.js"></script>
<style>
#upload-container, #upload-list{width: 500px; margin: 0 auto; }
#upload-container{cursor: pointer; border-radius: 15px; background: #EEEFFF; height: 200px;}
#upload-list{height: 800px; border: 1px solid #EEE; border-radius: 5px; margin-top: 10px; padding: 10px 20px;}
#upload-container>span{widows: 100%; text-align: center; color: gray; display: block; padding-top: 15%;}
.upload-item{margin-top: 5px; padding-bottom: 5px; border-bottom: 1px dashed gray;}
.percentage{height: 5px; background: green;}
.btn-delete, .btn-retry{cursor: pointer; color: gray;}
.btn-delete:hover{color: orange;}
.btn-retry:hover{color: green;}
</style>
<!--引入JS-->
<body>
<div id="upload-container">
<span>点击或将文件拖拽至此上传</span>
</div>
<div id="upload-list">
</div>
<button id="picker" style="display: none;">点击上传文件</button>
</body>

<script>
$('#upload-container').click(function(event) {
$("#picker").find('input').click();
});
var uploader = WebUploader.create({
auto: true,// 选完文件后，是否自动上传。
swf: 'Uploader.swf',// swf文件路径
server: 'http://localhost:8080/upload',// 文件接收服务端。
dnd: '#upload-container',
pick: '#picker',// 内部根据当前运行是创建，可能是input元素，也可能是flash. 这里是div的id
multiple: true, // 选择多个
chunked: true,// 开启分片上传。
threads: 20, // 上传并发数。允许同时最大上传进程数。
method: 'POST', // 文件上传方式，POST或者GET。
fileSizeLimit: 1024*1024*1024*10, //验证文件总大小是否超出限制, 超出则不允许加入队列。
fileSingleSizeLimit: 1024*1024*1024, //验证单个文件大小是否超出限制, 超出则不允许加入队列。
fileVal:'upload' // [默认值：'file'] 设置文件上传域的name。
});

uploader.on("beforeFileQueued", function(file) {
console.log(file); // 获取文件的后缀
});

uploader.on('fileQueued', function(file) {
// 选中文件时要做的事情，比如在页面中显示选中的文件并添加到文件列表，获取文件的大小，文件类型等
console.log(file.ext); // 获取文件的后缀
console.log(file.size);// 获取文件的大小
console.log(file.name);
var html = '<div class="upload-item"><span>文件名：'+file.name+'</span><span data-file_id="'+file.id+'" class="btn-delete">删除</span><span data-file_id="'+file.id+'" class="btn-retry">重试</span><div class="percentage '+file.id+'" style="width: 0%;"></div></div>';
$('#upload-list').append(html);
uploader.md5File( file )//大文件秒传

// 及时显示进度
.progress(function(percentage) {
console.log('Percentage:', percentage);
})

// 完成
.then(function(val) {
console.log('md5 result:', val);
});
});

uploader.on('uploadProgress', function(file, percentage) {
console.log(percentage * 100 + '%');
var width = $('.upload-item').width();
$('.'+file.id).width(width*percentage);
});

uploader.on('uploadSuccess', function(file, response) {
console.log(file.id+"传输成功");
});

uploader.on('uploadError', function(file) {
console.log(file);
console.log(file.id+'upload error')
});

$('#upload-list').on('click', '.upload-item .btn-delete', function() {
// 从文件队列中删除某个文件id
file_id = $(this).data('file_id');
// uploader.removeFile(file_id); // 标记文件状态为已取消
uploader.removeFile(file_id, true); // 从queue中删除
console.log(uploader.getFiles());
});

$('#upload-list').on('click', '.btn-retry', function() {
uploader.retry($(this).data('file_id'));
});

uploader.on('uploadComplete', function(file) {
console.log(uploader.getFiles());
});
</script>
</html>


后端，springboot框架，Apache httpclient文件上传组件 fileupload
#不启用对文件上传的支持。
spring:
servlet:
multipart:
enabled: false

pom.xml引入依赖

<dependencies>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
<version>2.3.1.RELEASE</version>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-autoconfigure</artifactId>
<version>2.3.1.RELEASE</version>
</dependency>

<dependency>
<groupId>commons-fileupload</groupId>
<artifactId>commons-fileupload</artifactId>
<version>1.3.1</version>
</dependency>
<dependency>
<groupId>commons-io</groupId>
<artifactId>commons-io</artifactId>
<version>2.4</version>
</dependency>

<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpcore</artifactId>
<version>4.4.10</version>
</dependency>

<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpclient</artifactId>
<version>4.5.6</version>
</dependency>
</dependencies>


文件上传UploadController

import org.apache.commons.fileupload.FileItem;
import org.apache.commons.fileupload.disk.DiskFileItemFactory;
import org.apache.commons.fileupload.servlet.ServletFileUpload;
import org.apache.commons.io.FileUtils;
import org.springframework.stereotype.Controller;
import org.springframework.web.bind.annotation.RequestMapping;
import org.springframework.web.bind.annotation.ResponseBody;

import javax.servlet.http.HttpServletRequest;
import javax.servlet.http.HttpServletResponse;
import java.io.BufferedOutputStream;
import java.io.File;
import java.io.FileOutputStream;
import java.io.IOException;
import java.util.List;

@Controller
public class UploadController {

private final static String utf8 ="utf-8";
@RequestMapping("/upload")
@ResponseBody
public void upload(HttpServletRequest request, HttpServletResponse response) throws Exception {

//分片
response.setCharacterEncoding(utf8);
Integer schunk = null; //分片
Integer schunks = null; //总分片
String name = null;
String uploadPath = "F:\\fileItem";
BufferedOutputStream os = null;
try{
DiskFileItemFactory factory = new DiskFileItemFactory();
factory.setSizeThreshold(1024);
factory.setRepository(new File(uploadPath));
ServletFileUpload upload = new ServletFileUpload(factory);
upload.setFileSizeMax(5l *1024l *1024l*1024l);//设置每个文件大小
upload.setSizeMax(10l *1024l *1024l*1024l);//设置总大小
List<FileItem> items = upload.parseRequest(request);

for(FileItem item : items){
if(item.isFormField()){
if("chunk".equals(item.getFieldName())){
schunk = Integer.parseInt(item.getString(utf8));
}
if("chunks".equals(item.getFieldName())){
schunks = Integer.parseInt(item.getString(utf8));
}
if("name".equals(item.getFieldName())){
name = item.getString(utf8);
}
}
}
for(FileItem item : items){
if(!item.isFormField()){
String temFileName = name;
if(name != null){
if(schunk != null){
temFileName = schunk +"_"+name;
}
File temFile = new File(uploadPath,temFileName);
if(!temFile.exists()){//断点续传
item.write(temFile);
}
}
}
}
//文件合并
if(schunk != null && schunk.intValue() == schunks.intValue()-1){
File tempFile = new File(uploadPath,name);
os = new BufferedOutputStream(new FileOutputStream(tempFile));

for(int i=0 ;i<schunks;i++){
File file = new File(uploadPath,i+"_"+name);
while(!file.exists()){
Thread.sleep(100);
}
byte[] bytes = FileUtils.readFileToByteArray(file);
os.write(bytes);
os.flush();
file.delete();
}
os.flush();
}
response.getWriter().write("上传成功"+name);
}finally {
try{
if(os != null){
os.close();
}
}catch (IOException e){
e.printStackTrace();
}
}
}
}



文件下载DownLoadController，后端java实现分片合并

import org.springframework.stereotype.Controller;
import org.springframework.web.bind.annotation.RequestMapping;

import javax.servlet.http.HttpServletRequest;
import javax.servlet.http.HttpServletResponse;
import java.io.*;
import java.net.URLEncoder;

@Controller
public class DownLoadController {
private final static String utf8 ="utf-8";
@RequestMapping("/download")
public void downLoadFile(HttpServletRequest request, HttpServletResponse response) throws Exception {
File file = new File("/dot/file/视频文件.mp4");
response.setCharacterEncoding(utf8);
InputStream is = null;
OutputStream os = null;
try{
//分片下载 http Range bytes=100-1000 bytes=100-
long fSize = file.length();
response.setContentType("application/x-download");
String fileName = URLEncoder.encode(file.getName(),utf8);
response.addHeader("Content-Disposition","attachment;filename=" + fileName);
response.setHeader("Accept-Range","bytes");

response.setHeader("fSize",String.valueOf(fSize));
response.setHeader("fName",fileName);

long pos = 0,last = fSize-1,sum = 0;
if(null != request.getHeader("Range")){
response.setStatus(HttpServletResponse.SC_PARTIAL_CONTENT);

String numRange = request.getHeader("Range").replaceAll("bytes=","");
String[] strRange = numRange.split("-");
if(strRange.length == 2){
pos = Long.parseLong(strRange[0].trim());
last = Long.parseLong(strRange[1].trim());
if(last > fSize-1){
last = fSize-1;
}
}else{
pos = Long.parseLong(numRange.replaceAll("-","").trim());
}
}
long rangeLenght = last - pos +1;
String contentRange = new StringBuffer("bytes ").append(pos).append("-").append(last).append("/").append(fSize).toString();
response.setHeader("Content-Range",contentRange);
response.setHeader("Content-Lenght",String.valueOf(rangeLenght));

os = new BufferedOutputStream(response.getOutputStream());
is = new BufferedInputStream(new FileInputStream(file));
is.skip(pos);
byte[] buffer = new byte[1024];
int lenght = 0;
while(sum < rangeLenght){
lenght = is.read(buffer,0,((rangeLenght-sum) <= buffer.length ? ((int)(rangeLenght-sum)) : buffer.length));
sum = sum+ lenght;
os.write(buffer,0,lenght);
}
System.out.println("下载完成");
}finally {
if(is != null){
is.close();
}
if(os != null){
os.close();
}
}
}
}



文件下载DownloadClient，前端/浏览器端实现分片合并


import org.apache.commons.io.FileUtils;
import org.apache.http.HttpEntity;
import org.apache.http.HttpResponse;
import org.apache.http.client.HttpClient;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.impl.client.HttpClients;
import org.springframework.web.bind.annotation.RequestMapping;
import org.springframework.web.bind.annotation.RestController;

import java.io.*;
import java.net.URLDecoder;
import java.util.concurrent.ExecutorService;
import java.util.concurrent.Executors;

@RestController
public class DownloadClient {

private final static long PER_PAGE = 1024l *1024l * 50l;
private final static String DOWNPATH = "dot/file/fileItem";
ExecutorService pool = Executors.newFixedThreadPool(10); //多线程，线程池下载文件

@RequestMapping("/downloadFile")
public String downloadFile() throws Exception {
FileInfo fileInfo = download( 0, 10, -1, null);
//总分片数量
long pages = fileInfo.fSize / PER_PAGE;
for(long i=0;i<=pages; i++){
pool.submit(new Download(i*PER_PAGE,(i+1)*PER_PAGE-1,i,fileInfo.fName));
}


return "success";
}

class FileInfo{
long fSize;
String fName;

public FileInfo(long fSize, String fName) {
this.fSize = fSize;
this.fName = fName;
}
}
class Download implements Runnable{
long start;
long end;
long page;
String fName;

public Download(long start, long end, long page, String fName) {
this.start = start;
this.end = end;
this.page = page;
this.fName = fName;
}

public void run() {
try {
FileInfo info = download( start, end, page, fName);
} catch (Exception e) {
e.printStackTrace();
}
}
}
private FileInfo download(long start,long end,long page,String fName) throws Exception {
File file = new File(DOWNPATH,page+"-"+fName);
if(file.exists()){
return null;
}
HttpClient client = HttpClients.createDefault();
HttpGet httpGet = new HttpGet("http://127.0.0.1:8080/download");
httpGet.setHeader("Range","bytes="+start+"-"+end);

HttpResponse response = client.execute(httpGet);
HttpEntity entity = response.getEntity();
InputStream is = entity.getContent();

String fSize = response.getFirstHeader("fSize").getValue();
fName = URLDecoder.decode(response.getFirstHeader("fName").getValue(),"utf-8");

FileOutputStream fis = new FileOutputStream(file);
byte[] buffer = new byte[1024];
int ch =0;
while((ch = is.read(buffer)) != -1){
fis.write(buffer,0,ch);
}
is.close();
fis.flush();
fis.close();

if(end - Long.valueOf(fSize) >= 0){//最后一个分片
mergeFile(fName,page);
}
return new FileInfo(Long.valueOf(fSize),fName);
}

private void mergeFile(String fName, long page) throws Exception {
File tempFile = new File(DOWNPATH,fName);
BufferedOutputStream os = new BufferedOutputStream(new FileOutputStream(tempFile));

for(int i=0 ;i<=page;i++){
File file = new File(DOWNPATH,i+"-"+fName);
while(!file.exists() || (i != page && file.length() < PER_PAGE)){
Thread.sleep(100);
}
byte[] bytes = FileUtils.readFileToByteArray(file);
os.write(bytes);
os.flush();
file.delete();
}
File file = new File(DOWNPATH,-1+"-null");
file.delete();
os.flush();
os.close();
//文件子节计算导致文件不完整
//流未关闭
}
}

 

参考文章：http://blog.ncmem.com/wordpress/2023/11/16/springboot%e6%95%b4%e5%90%88%e5%89%8d%e7%ab%af%e5%ae%9e%e7%8e%b0%e6%96%ad%e7%82%b9%e7%bb%ad%e4%bc%a0%e3%80%81%e5%a4%a7%e6%96%87%e4%bb%b6%e7%a7%92%e4%bc%a0%e4%bb%a5%e5%8f%8a%e5%a4%9a%e7%ba%bf%e7%a8%8b/

欢迎入群一起讨论

 

 

标签：断点续传,springboot,org,fName,upload,file,import,new,多线程
From： https://www.cnblogs.com/songsu/p/17836950.html

相关文章

  • springboot 集成dubbo 关键配置：
    1.pom<!--dubbo与zk的组件start--><dependency><groupId>com.alibaba.boot</groupId><artifactId>dubbo-spring-boot-starter</artifactId><version>0.1.0</version></dependency><dependency>......
  • 多线程threading模块(二)daemon和join的区别
    PythonVersion：3.10.12案列一：最简洁的情况，在多线程代码中不开启daemon或join功能。importthreadingimporttimeloop_count=5defcount_num(num):print('子线程<{}>开始运行'.format(num))forxinrange(10):time.sleep(x)print('子线程<{}>结束......
  • 通过linux etc/init.d 来执行springboot jar
    今天解开了一个困扰我好久的问题，我们的项目到底是怎么执行的？为什么把项目的jar包scp到服务器，然后再创建一个同名的conf文件，之后建立一个软连接就可以start和stop了？springbootjar和普通jar的区别springbootjar是可执行的不可以被其他项目依赖的普通jar是不可执行的是可以......
  • SpringBoot 中大文件（分片上传）断点续传与极速秒传功能的实现
    1.背景在实际项目中，我们经常会遇到需要上传大文件的情况，常见的方法是将整个文件一次性上传，在文件较大时会出现上传速度慢或者可能导致上传失败等问题。针对这种情况，通常可以采用分片上传的方式，将文件分为多个小片段进行上传，降低单个上传请求的负载，提高上传效率。同时，考虑到用户......
  • JavaSE day07-异常,多线程
    JavaSEday07-异常,多线程今日目标:异常的概述异常的分类异常的处理方式自定义异常多线程入门1异常的概述1.1什么是异常?异常就是程序出现了不正常情况,程序在执行过程中,数据导致程序不正常,最终导致了JVM的非正常停止注意:语句错误不算在异常体系中1.......
  • springboot大文件上传、分片上传、断点续传、秒传的实现
    本篇攻略将详细介绍如何使用SpringBoot实现大文件上传、分片上传、断点续传和秒传功能。为方便阅读，本文将分为以下几个部分：介绍大文件上传、分片上传、断点续传和秒传的概念详细分析如何实现大文件上传、分片上传、断点续传和秒传功能给出两个示例来说明如何实现大文件上传和......
  • Java 创建多线程的三种方法
    在Java中创建多线程，往往都要通过Thread类来实现，今天学习下Java中创建多线程的三种方法[1]。1.继承Thread类通过继承Thread类实现多线程。主要方法：1.voidrun(),线程开启后，方法将被调用执行2.voidstart(),使此线程开始执行,Java虚拟机会调用run()方法实现步骤:1.定......
  • Java 多线程安全的使用小结
    在使用多线程进行编程的过程中，难免遇到共享资源读写问题，这是为了线程安全，一种思路就是使用锁来控制并发读写问题。在通过锁来实现并发安全中，常用的有以下几种：synchronized，对象锁ReentrantLock，重入锁ReentrantReadWriteLock，读写锁今天从使用的角度来看看这几种锁是如何使......
  • SpringBoot
    一、简介SpringBoot是Spring公司的一个顶级项目，和SpringFramework是一个级别的。不需要编写xml配置文件，通过利用pringFramework4自动配置特性完成配置。启动器就是引入相关的依赖，通过java配置的方式完成自动配置。1.特征使用SpringBoot可以创建独立的Spring应......
  • day130-springboot的各种配置与应用
    编写springboot应用看官方文档DevelopingwithSpringBoot查看场景依赖，引入对应自动配置的场景，编写配置文件中debug=true开启自动配置报告。Negative（不生效）Positive（生效）Lombok的应用Lombok用标签方式代替构造器、getter/setter、toString()等鸡肋代码。引入依赖......

赞助商

阅读排行

网站主页关于我们联系我们网站地图

本网站内容转载自其他媒体，侵权联系[admin##ips99.com]。

Copyright © 2020-2023 IPS99 版权所有 IPS99