a.txt內(nèi)容如下:
123
456
789
123
123
789
獲取重復(fù)的行,并且重復(fù)的行只保留一次,處理后得到b.txt內(nèi)容如下:
123
789
方法1:
@echo offREM 缺點(diǎn)1:無(wú)法處理特別大的文件REM 缺點(diǎn)2:需要使用文件中沒(méi)有出現(xiàn)的字符來(lái)標(biāo)記變量(本例中使用的是下劃線)setlocalfor /f "delims=" %%i in (a.txt) do ( set /a _%%i+=1)(for /f "tokens=1-2 delims=_=" %%i in ('set _') do ( if %%j gtr 1 ( echo,%%i )))>b.txtendlocal
方法2:
@echo offsetlocal enabledelayedexpansionset "PriLine="set "DupNum=1"(for /f "delims=" %%i in ('sort a.txt') do ( if "!PriLine!" equ "%%i" ( set /a DupNum+=1 ) else ( if !DupNum! gtr 1 ( echo,!PriLine! ) set DupNum=1 ) set "PriLine=%%i"))>b.txtif !DupNum! gtr 1 ( >>b.txt echo,!PriLine!)
方法3:
gawk "{a[$0]++}END{for(i in a)if(a[i]>1)print i}" a.txt > b.txt
方法4:(更加簡(jiǎn)潔)
gawk "a[$0]++" a.txt>b.txt
方法5:
@echo offfor /f "tokens=*" %%i in (a.txt) do set #%%i=%%i(for /f "tokens=2 delims==" %%i in ('set #') do echo %%i)>b.txt
新聞熱點(diǎn)
疑難解答