怎么样在解析文件时过滤掉重复的数据?
生了锈的钢笔
|
1#
生了锈的钢笔 发表于 2008-11-03 08:59
怎么样在解析文件时过滤掉重复的数据?
怎么样在解析文件时过滤掉重复的数据?
[b][/b]2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 tangchaodajiudian_1_m 1169 28690 2638 0 26 0 32 0 4 0 0 3629 0 0 22 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 tangchaodajiudian_2_m 1170 28694 17506 0 26 0 32 0 0 0 0 2048 0 0 1 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 anxing_2 82 28693 11939 50067 68 0 80 1 0 0 0 31593 0 0 64 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 anxing_3 83 28693 7478 46012 54 0 64 1 0 0 0 32628 0 0 74 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fangtai_1 129 28697 36616 0 82 0 96 1 1 0 0 8404 0 0 11 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fangtai_2 130 28695 13385 62899 82 0 96 0 2 0 0 27352 0 0 22 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fangtai_3 131 28697 28268 159201 81 0 104 7 1 0 0 81753 0 0 95 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1DCS_1_m 145 28692 0 0 40 0 48 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1DCS_2_m 146 28689 0 0 40 0 48 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1GSM_1_m 257 28691 0 0 54 0 64 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1GSM_2_m 258 28689 0 0 54 0 64 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2DCS_1_m 273 28693 0 0 40 0 48 0 0 0 0 3 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 choubeichu_wai 33 28696 1817 0 54 0 64 0 0 0 0 2631 0 0 9 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2DCS_2_m 274 28692 0 0 40 0 48 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2GSM_1_m 289 28691 17 0 54 0 64 0 0 0 0 6 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2GSM_2_m 290 28690 0 0 54 0 64 0 0 0 0 13 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 new-fangtaiDCS_3 115 28691 35370 0 64 8 48 0 1 0 0 13282 0 0 14 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 xinqin_1 353 28693 60231 0 54 0 64 0 1 0 0 52016 0 0 217 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 tangchaodajiudian_1_m 1169 28690 2638 0 26 0 32 0 4 0 0 3629 0 0 22 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 tangchaodajiudian_2_m 1170 28694 17506 0 26 0 32 0 0 0 0 2048 0 0 1 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 anxing_2 82 28693 11939 50067 68 0 80 1 0 0 0 31593 0 0 64 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 anxing_3 83 28693 7478 46012 54 0 64 1 0 0 0 32628 0 0 74 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fangtai_1 129 28697 36616 0 82 0 96 1 1 0 0 8404 0 0 11 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fangtai_2 130 28695 13385 62899 82 0 96 0 2 0 0 27352 0 0 22 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fangtai_3 131 28697 28268 159201 81 0 104 7 1 0 0 81753 0 0 95 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1DCS_1_m 145 28692 0 0 40 0 48 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1DCS_2_m 146 28689 0 0 40 0 48 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1GSM_1_m 257 28691 0 0 54 0 64 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai1GSM_2_m 258 28689 0 0 54 0 64 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2DCS_1_m 273 28693 0 0 40 0 48 0 0 0 0 3 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 choubeichu_wai 33 28696 1817 0 54 0 64 0 0 0 0 2631 0 0 9 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2DCS_2_m 274 28692 0 0 40 0 48 0 0 0 0 0 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2GSM_1_m 289 28691 17 0 54 0 64 0 0 0 0 6 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 fukantai2GSM_2_m 290 28690 0 0 54 0 64 0 0 0 0 13 0 0 0 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 new-fangtaiDCS_3 115 28691 35370 0 64 8 48 0 1 0 0 13282 0 0 14 2008-10-28T16:00:00 2008-10-28T17:00:00 BSC1_0 xinqin_1 353 28693 60231 0 54 0 64 0 1 0 0 52016 0 0 217 每一条都有重复的一条，要怎么才过滤掉？ |