Wilamowski B.M., Irwin J.D. The Industrial Electronics Handbook. Second Edition: Industrial Communication Systems

Подождите немного. Документ загружается.

65-10 Industrial Communication Systems

references

[Banaei-Kashani.04].F..Banaei-Kashani,.C.-C..Chen,.and.C..Shahabi,.WSPDS:.Web.services.peer-to-peer.

disco

very

.serv

ice,

.Int

ernational Symposium on Web Services and Applications,

.Las.Vegas,.NV,.2004,.

pp..733–743.

[Bu

schmann

.96].F..Bus

chmann,

.R..Meunier,.H..Rohn

ert,

.P..Somm

erlad,

.and.M..Sta

.Patt

ern-Oriented

Soware Architecture,

.a Sys

tem of Patterns,

.Jo

.Wi

ley

.&.So

ns,

.Chic

hester,

.U.K.,.1996.

[Bu

ssler

.05].C..Bus

sler,

.E..Kilga

rri,

.R..Krumm

enacher

.et.al.,.WSMX.tri

ple-space

.comp

uting,

.WSM

Wor

king

.Dra,.ht

tp://www.wsmo.org/TR/d21/v0.1/20050613,

.2005.

[Ch

ang

.07].E..Cha

ng,

.T..S..Dillo

.and.F..Hus

sain,

.Tru

.ont

ologies

.for.e-serv

ice

.envir

onments,

.Int

ernational

Journal of Intelligent Systems,

.22(5),.519–545,.2007.

[Ch

ang

.06].E..Cha

ng,

.T..S..Dillo

.and.F..Hus

sain,

.Tru

st and Reputation for Service-Oriented Environments:

Tec

hnology for Building Business Intelligence and Consumer Condence,

. John. Wile

. &. Son

Chich

ester,

.U.K.,.2006.

[Ch

eah

.07].C..Che

ah,

.Onto

logical

.meth

odologies—From

.open.sta

ndards

.so

ware

.deve

lopment

.to.open.

sta

ndards

.orga

nizational

.pro

ject

.gov

ernance,

.Int

ernational Journal of Computer Science and Network

Security,

.7(3),.283–289,.2007.

[Ch

.07].H..Chen,.P..B..Cho

.N..H..Coh

en,

.and.S..Duri

.Exten

ding

.SOA/MDD.to.sens

ors

.and.actu

ators

for.sens

.and.resp

ond

.busin

ess

.pro

cesses,

.IEEE In

ternational Conference on E-Business Engineering,

Hon

.Ko

ng,

.Chin

.2007,.pp

.54–61.

[De

lamar

.06].J..Las

tra

.and.I..Del

amer,

.Sema

ntic

.web.serv

ices

.in.facto

.aut

omation:

.Fund

amental

.insigh

and.research.roadmap,.2006.

[Dil

lon

.07a].T..S..Dillo

.C..Wu,.and.E..Cha

ng,

.Refer

ence

.arc

hitectural

.sty

les

.for.serv

ice-oriented

.comp

ut-

ing

.(key

note),

.IFIP In

ternational Conference on Network and Parallel Computing,

.Vol

.4672,.LNCS,.

Dali

an,

.Chin

.2007,.pp

.543–555,.Sp

ringer.

[Dillon

.07b].T..S..Dillo

.C..Wu,.and.E..Cha

ng,

.GRIDSpace:.Sema

ntic

.grid.serv

ices

.on.the.web.(key

note),

ir

d IEEE International Conference on Semantics,

.Kno

wledge and Grid

.(SK

G 2007),

.Xia

.China,.

2007,.pp

.7–13.

[Eugs

ter

.03].P..T..Eugst

er,

.P..A..Fel

ber,

.R..Guerrao

ui,

.and.A.-M..Kerm

arrec,

. e.man

.faces.of.pub

lish/

subscribe,

.ACM C

omputing Surveys,

.35,.114–131,.2003.

[Fieldin

. 02]. R.. Fielding

. and. R.. Tay

lor,

. Prin

cipled

. design. of. the. moder

. Web. arc

hitecture,

. ACM

ansactions on Internet Technology (TOIT),

.2,.115–150,.2002.

[Ge

lernter

.85].D..Geler

nter,

.Genera

tive

.communic

ation

.in.Lind

.ACM T

ransactions on Programming

Language and Systems,

.7(1),.80–112,.1985.

[Gr

uber

.93].T..Gru

ber,

.A.tran

slation

.app

roach

.to.por

table

.ont

ology

.spe

cications,

.Kno

wledge Acquisition,

5,.199–220,.1993.

[Hadzic

.05].M..Hadzic.and.E..Cha

ng,

.Onto

logy-based

.sup

port

.for.huma

.dise

ase

.stud

.Pro

ceedings of the

Hawaii International Conference on System Sciences

.(HICSS-38),.Big.Island,.HI,.2005.

[Hadzic

.07].M..Hadzic.and.R..Cowa

. ree.fold.system.(3FS).for.ment

.hea

lth

.doma

in,

.in.Pro

ceedings

of the 2007 OTM Confederated International Conference on On the Move to Meaningful Internet

Systems—Volume Part II,

.2007,.Sp

ringer-Verlag,

.Ber

lin,

.pp

.1355—1364.

anish

.97].A..A..Han

ish

.and.T..S..Dil

lon,

.Com

munication

.pro

tocol

.des

ign

.to.fac

ilitate

.re-

use

.bas

on.the.obj

ect-oriented

.par

adigm,

.Mobi

le Networks and Applications Journal,

.2(3

.285

–301,

.199

(Sp

.Iss

ue).

[Holland

.00].W..Hol

land

.and.W..Bro

nsvoort,

.Ass

embly

.fea

tures

.in.mode

ling

.and.pla

nning,

.Rob

otics and

Computer-Integrated Manufacturing,

.16,.277–294,.2000.

arrar

. 02]. M.. Jar

rar

. and. R.. Meer

sman,

. For

mal

. ont

ology

. engin

eering

. in. the. DOGMA. app

roach,

Int

ernational Conference on Ontologies,

.Dat

abases,

.and

Applications of Semantics

.(OD

Base 2002),

Vol

.2519,.LNCS,.Ir

vine,

.CA,.2002,.pp

.1238–1254,.Sp

ringer.

Semantic Web Services for Manufacturing Industry 65-11

[Jensen.96].K..Jensen,.Coloured Petri Nets:.Basic Concepts,.Analysis Methods and Practical Use,.Vol..1,.

Spr

inger-Verlag,

.Lo

ndon,

.U.K.,.1996.

[Klein

.02].M..Klein,.D..Fens

el,

.A..Kirya

kov,

.and.D..Ognya

nov,

.Onto

logy

.versio

ning

.and.cha

nge

.detec-

ion

.on.the.web

.Pro

ceedings of the 13th International Conference on Knowledge Engineering and

Knowledge Management

.(EK

AW 02),

.Siguenza,.Sp

ain,

.2002,.pp

.197–212.

[Kl

yne

.04].G..Kly

.and.J..J..Car

roll,

.Reso

urce

.descri

ption

.fram

ework

.(RDF):.Con

cepts

.and.ab-st

ract

synt

ax,

.W3C.Re

commendation,

.ht

tp://www.w3.org/TR/rdf-concepts/,

.2004.

[Kr

ummenacher

.05].R..Krumm

enacher,

.M..Hepp

.A..Pol

leres,

.C..Bus

sler,

.and.D..Fens

el,

.WWW.or.wha

.is.

wro

.wit

.web.serv

ices,

.Pro

ceedings of the ird IEEE European Conference on Web Services,

.Vaxjo

Swe

den,

.2005,.pp

.235–243.

[La

stra

.04].J..L..Mar

tinez

.Las

tra,

.Refer

ence

.mec

hatronic

.arc

hitecture

.for.acto

r-based

.ass

embly

.system

Doc

toral

.th

esis,

.Ta

mpere

.Uni

versity

.of.Te

chnology,

.Ta

mpere,

.Finl

and,

.2004.

[Pier

.03].P..Piers,.M..Bene

vides,

.and.M..Mat

toso,

.Medi

ating

.heter

ogeneous

.web.serv

ices,

.Sym

posium on

Applications and the Internet

.(SAINT 2003

.Orl

ando,

.FL,.2003.

[Pi

lioura

.04].T..Pilio

ura,

.G..Kap

os,

.and.A..Tsa

lgatidou,

.PYRAMID-S:.A.sca

lable

.infras

tructure

.for.sema

tic

.web.serv

ice

.pub

lication

.and.disco

very,

.Pro

ceedings of the 14th International Workshop Research.

Issues on Data Engineering,

.Bos

ton,

.MA,.2004.

[Po

rnpit

.05].P..Won

gthongtham,

.E..Cha

ng,

.T..Dillo

.and.I..Somm

erville,

.So

ware

.engin

eering

.ont

olo-

gies

.and.their.implem

entation,

.in.Kob

ol,

.P..(Ed.),.IAS

TED International Conference on Soware

Engineering

.(SE),.Innsbruck,.Austria,.pp..208–213,.February.15,.2005,.IASTED,.Austria.

[Pornpit

.06].P..Won

gthongtham,

.E..Cha

ng,

.T..Dillo

.and.I..Somm

erville,

.Onto

logy-based

.mul

ti-site

.so-

.dev

elopment

.met

hodology

.an

.to

ols.

.Jo

urnal of Systems Architecture,

.52,.640–653,.2006.

[Sid

.08].A..S..Sid

hu,

.T..S..Dil

lon,

.an

.E..Ch

ang,

.Pr

otein Ontology,

.Sp

ringer,

.Ne

.Yo

rk,

.2008.

[Sid

.05].A..S..Sidh

.T..S..Dillo

.E..Cha

ng,

.and.B..S..Sidh

.Pro

tein

.ont

ology:

.Voc

abulary

.for.pro-

ein

.dat

.Pro

ceedings of the ird International IEEE Conference on Information Technology and

Application

.(IEEE I

CITA 2005),

.Sy

dney,

.Au

stralia,

.2005,.pp

.465–469,.IEEE.

[Sj

elvgren

.83].D..Sje

lvgren,

.S..Ander

sson,

.T..Ander

sson,

.U..Nyb

erg,

.and.T..S..Dillo

.Opt

imal

.opera-

ions

.pla

nning

.in.a.lar

.hydr

o-thermal

.pow

.system,.IEEE Tr

ansactions on Power Apparatus and

Systems,

.102(11),.3644–3651.

[Sp

yns

.02].P..Spy

ns,

.R..Meer

sman,

.and.M..Jar

rar,

.Dat

.mode

lling

.vers

.ont

ology

.engin

eering,

.SIGM

Record,

.31(4):12–17,.Ma

rch

.2002.

[Vin

oski

.02].S..Vinos

ki,

.Putt

ing

.the.“We

b”

.into.Web.serv

ices—Web

.serv

ices

.interac

tion

.mode

ls,

.par

.2,.

IEEE Int

ernet Computing,

.6(4),.90–92,.Ju

.2002.

ang

.04].J..Wan

.B..Jin

.and.J..Li,.An.ont

ology-based

.pub

lish/subscribe

.sys

tem,

.Mid

dleware 2004,

Vol

.323

.Lec

ture

.Not

.in.Com

puter

.Sci

ence,

.Tor

onto,

.Can

ada,

.200

.pp..232

–253.

[Wongthongtham

.06].P..Won

gthongtham,

.E..Cha

ng,

.T..S..Dillo

.and.I..Somm

erville,

.Onto

logy-based

mul

ti-site

. so

ware

. deve

lopment

. meth

odology

. and. too

ls,

. Jou

rnal of Systems Architecture,

. 52,.

640–653.

[Wou

ters

.03].C..Wou

ters,

.T..S..Dillo

.J..W..Rah

ayu,

.E..Cha

ng,

.and.R..Meer

sman,

.Onto

logies

.on.the.

MOVE,.Nin

th International Conference on Database Systems for Advanced Applications

.(DA

SFAA

‘04),

.Jej

.Is

land,

.Ko

rea,

.2004,.pp

.812–823,.Sp

ringer.

[Wouters

.02].C..Wou

ters,

.T..S..Dillo

.J..W..Rah

ayu,

.and.E..Cha

ng,

.A.Pract

ical

.walk

through

.of.the.ont

ol-

ogy

.deriva

tion

.rules,.13th I

nternational Conference on Database and Expert Systems Applications,

Aix-en-Pr

ovence,

.Fra

nce,

.2002,.pp

.259–268,.Sp

ringer.

[Zurawski

.92].R..Z..Zuraws

.and.T..S..Dillo

.Aut

omatic

.synt

hesis

.of.FMS.system.design.mode

.fro

.sys-

tem

.req

uirements,

.IEEE In

ternational Conference on Emerging Technology and Factory Automation,

Mel

bourne,

.Au

stralia,

.1992,.pp

.62–67.

66-1

66.1 Introduction

With.the.tremendous.growth.in.available.information.to.the.masses,.the.question.is.how.users.can.

sear

.the.usef

.info

rmation

.in.the.shor

test

.time.[PW0

9,NGW08,PYW10].

.In.othe

.word

.maki

.use.

of.cons

olidated

.info

rmation

.requ

ires

.such.subs

tantial

.eor

.since.the.web.page

.are.gene

rated

.for.visu

alization

.and.not.for.data.exch

ange

.[KCS

G07,W10].

.To.reac

.this.goal.requ

ires

.meth

ods

.deve

loped

.to.

optim

ize

.a.user

’s

.sear

ching

.proc

ess.

. is.chapt

.intr

oduces

.a.meth

.know

.as.the.data.mini

.robo

(DMR

)

.to.extr

act

.and.proc

ess

.data.by.using.PERL.scri

pting

.lang

uage.

. e.DMR.can.be.unde

rstood

quic

kly

.as.a.sow

are

.prog

ram

.that.serv

.for.mini

.data.autom

atically.

.Part

icularly,

.with.data.mini

from.serv

ers,

.this.meth

.does.not.use.any.brow

ser

.to.hand

.the.Web,.but.does.so.dire

ctly

.by.using.

PERL.modu

les

.(so

ware

.prog

rams

.are.writ

ten

.for.a.spec

ic

.func

tion)

.such.as.LWP.. e.use.of.thes

modu

les

.tur

.the.DMR.into.an.ee

ctive

.sol

ution

.to.ext

ract

.dat

.wit

.an.acc

elerated

.spe

ed.

.proc

edure

.of.exec

ution

.of.the.DMR.can.be.divi

ded

.into.thre

.step

.(1).Data.coll

ection:

.to.extr

act

all.info

rmation

.from.the.data.sour

ce.

.(2).Data.Filt

ering:

.to.extr

act

.the.usef

.info

rmation

.buil

.in.step.1..

(3).Dat

.pro

cessing:

.to.pro

cess

.and.sor

.the.ext

racted

.inf

ormation

.in.a.for

mat

.tha

.is.ee

ctive

.for.use

rs.

DMR

.can.be.writ

ten

.in.scri

pting

.lang

uages

.such.as.PHP,.PERL

.or.C..PERL.is.one.of.the.most.powe

rful

tool

.in.data.mani

pulation

.with.the.powe

rful

.regu

lar

.expr

ession.

.To.run.DMR.is.simp

le.

.Prog

rammers

.only.

need.to.inst

all

.PERL.scri

pting

.lang

uage,

.which.is.an.inte

rpreted

.lang

uage,

.it.is.pars

.and.exec

uted

.at.run-

ime

.inst

ead

.of.bein

.comp

iled

.into.bina

.form.and.then.run..More

over,

.this.is.an.open

-source

.sow

are

.for.

the.user

.with.the.stan

dard

.modu

les,

.which.also.come.with.PERL

.Like.the.buil

t-in

.func

tions,

.thes

.modu

les

prov

ide

.user

.with.hund

reds

.of.prew

ritten

.reso

urces.

. e.modu

les

.are.made.up.of.PERL.code.writ

ten

.in.a.

way.to.confo

.to.cert

ain

.conv

entions

.so.user

.can.acce

.that.code.from.thei

.prog

ram.

. e.PERL.modu

les

prov

ide

.user

.with.a.grea

.deal.of.the.prew

ritten

.code.and.are.stor

.in.les.with.exte

nsion

.“.pm

.”

.User

.can.

load.such.the.modu

les

.into.thei

.code.by.usin

.the.“use

”

.stat

ement.

Automatic Data Mining

on Internet by Using

PERL Scripting Language

66.1. Introduction.....................................................................................66-1

PERL.Scripting.Language. •. Regular.Expressions. •. Web.Browser

66.2. Examples...........................................................................................66-4

Extract.E-Mail.Addresses.from.Excel.Files. •. Extract.Data.from.

PDF.Files. •. Extract.Paper.Information.from.IEEE.XPLORE. •. List.

Papers.Only.in.a.Specic.Subject.from.TIE.Webpage. •. Using.PERL.

with.Google.Scholar.in.Searching.Data

66.3. Summary.and.Conclusion..............................................................66-8

References.....................................................................................................66-9

Nam Pham

Auburn University

Bogdan M.

Wilamowski

Auburn University

66-2 Industrial Communication Systems

66.1.1 PErL Scripting Language

PERL,.which.stands.for.“Practical.Extraction.and.Report.Language,”.was.written.by.Larry.Wall,.a.lin-

guist

.wor

king

.as.a.sys

tems

.adm

inistrator

.for.NAS

.in.the.lat

.198

0s,

.as.a.way.to.mak

.rep

ort

.pro

cessing

easi

er.

.It.is.a.pow

erful

.lan

guage

.for.doi

.dat

.man

ipulation

.tas

ks.

.It.is.por

table,

.acc

essible,

.and.exc

el-

lent

.at.han

dling

.tex

tual

.inf

ormation.

.It.has.bee

.use

.wit

.goo

.suc

cess

.for.sys

tem

.adm

inistration

.tas

on.Uni

.sys

tems,

.act

ing

.as.glu

.bet

ween

.di

erent

.com

puter

.sys

tems,

.Wor

.Wide.Web.CGI.pro

gram-

ming,

.as.we

.as.cu

stomizing

.th

.ou

tput

.fr

.ot

her

.pr

ograms.

PERL

.is.a.pro

minent

.Web.pro

gramming

.lan

guage

.bec

ause

.of.its.tex

.pro

cessing

.fea

tures.

.Han

dling

HTM

.fo

rms

.is.ma

.sim

ple

.by.th

.CG

I.pm

.mo

dule,

.a.pa

.of.PE

RL’s

.st

andard

.di

stribution.

66.1.2 regular Expressions

PERL.is.especially.good.at.handling.text,.and,.in.fact,.that.is.what.it. was.originally. developed. for..

Reg

ular

.exp

ressions

.are.a.big.par

.of.tex

.han

dling

.in.PER

.Reg

ular

.exp

ressions

.let.use

.wor

.wit

pat

tern

.mat

ching

.(th

.is,.com

paring

.str

ings

.to.a.tes

.str

ing—or

.a.pat

tern—that

.may.con

tain

.wil

dcards

and.oth

.spe

cial

.cha

racters)

.and.tex

.sub

stitution,

.pro

viding

.a.ver

.pow

erful

.way.to.man

ipulate

.tex

und

.pro

grammatic

.con

trol

.[H9

9].

.Unf

ortunately,

.usin

.reg

ular

.exp

ressions

.in.PER

.is.one.of.the.are

tha

.pro

grammers

.nd.the.mos

.dau

nting.

.Eve

.rel

atively

.str

aightforward

.reg

ular

.exp

ressions

.can.tak

som

.ti

.to.co

mprehend.

String1=∼ m/String2/

“=∼ m//”

.ope

rator

.mea

.tha

.str

ing1

.wil

.be.com

pared

.wit

.the.pat

tern

.tha

.is.str

ing2.

.If.

the.mat

.is.tru

.str

ing2

.wil

.be.a.par

.of.str

ing1,

.but.not.vic

.ver

sa.

.In.oth

.wor

ds,

.the.pat

tern

mat

ching

.ope

rator

.is.alw

ays

.use

.to.com

pare

.the.pat

tern

.on.the.rig

.han

.side.wit

.the.pat

tern

.on.the.

le.ha

.sid

.to.se

.if.it.t

.or.no

Assuming

.tha

.the

.are.100.di

erent

.nam

.in.a.lis

.and.we.wan

.to.kno

.if.Joh

.is.in.thi

.lis

.or.not

$a="Peter, Jack and Tom";

$b="Peter";

if ($a=∼m/$b/){print ("yes\n");}

elsif($a!∼m/$b/) {print("no\n")};

Result:

Yes

Instead

.of.usin

.the.sta

ndard

.str

ing

.as.a.pat

tern,

.use

.can.rep

lace

.it.by.“wil

dcards.”

. e.wil

dcards

.are.

jus

.spe

cial

.cha

racters

.to.gen

eralize

.a.str

ing.

.For.exa

mple,

.a.use

.may.wan

.to.kno

.if.the

.are.any.num

bers

.in.the.str

ing.

.In.thi

.cas

.a.use

.doe

.not.kno

.wha

.the.numb

.is.in.the.str

ing,

.so.the

.can

not

.use.

a.spe

cic

.numb

.as.the.pat

tern

.to.com

pare,

.but.the

.can.use.(\d

.ins

tead.

.d.is.an.int

eger,

.and.+.sign.

mea

.th

.in

teger

.of.le

ngth

.1.or.mo

re.

$a="Peter, Jack and Tom";

if ($a=∼m/(\d+)/){print ("yes\n");}

elsif($a!∼m/(\d+)/) {print("no\n")};

Result:

Below

.is.a.li

.of.so

.wi

dely

.us

.wi

ldcards:

.ma

tch

.an

.ch

aracter

.ma

tch

.wo

.ch

aracter

.ma

tch

.no

n-word

.ch

aracter

Automatic Data Mining on Internet by Using PERL Scripting Language 66-3

\s.match.whitespace.character

.ma

tch

.no

n-whitespace

.ch

aracter

.ma

tch

.di

git

.ch

aracter

.ma

tch

.no

n-digit

.ch

aracter

.ma

tch

.on

.or.mo

.ti

mes

66.1.3 Web Browser

 e.interaction.between.PERL.and.the.Internet.is.one.of.the.most.special.attributes.of.this.language..

Usin

.PER

.you.can.easi

.cre

ate

.Int

ernet

.app

lications

.tha

.use.Fil

.Tra

nsfer

.Pro

tocol

.(FT

P),

.e-m

ail,

Use

net,

.and.Hyp

ertext

.Tra

nsfer

.Pro

tocol

.(HT

TP),

.and.eve

.bro

wse

.the.Web

. er

.are.a.lot.of.mod

ules

.sup

porting

.pro

grammers

.to.do.tha

.Muc

.of.thi

.pow

.com

.fro

.CPA

.mod

ules

.tha

.can.be.

dow

nloaded

.and.ins

talled

.fro

.the.Web

.Sin

.use

.oe

.dow

nload

.le

.and.dat

.fro

.the.Int

ernet,

the.que

stion

.is,.can.PER

.emu

late

.a.web.bro

wser

.to.cop

.all.web.sou

rces

.into.loc

.le

. e.mod

ules

.as.

LWP

::Simple

.or.LW

P::UserAgent

.ha

.en

ough

.ca

pability

.to.do.th

at.

.usin

.the

.mod

ules,

.the.DMR.doe

.not.use.the.Web

. es

.mod

ules

.hav

.cap

ability

.to.dow

nload

a.web.pag

.In.oth

.wor

ds,

.the

.can.emu

late

.bro

wsers.

. e.fol

lowing

.exa

mple

.ill

ustrates

.the.dow

nload

of.the.mai

.FAQ.ind

.at.CPA

.by.usin

.the.“ge

t”

.fun

ction

.fro

.the.mod

ule

.LWP

::Simple

.and.stor

tha

.we

.pa

.in

.l

.na

me.html.

use LWP::Simple;

$add="http://www.cpan.org/doc/FAQs/index.html";

$content=get("$add");

open FILEHANDLE,">name.htm";

print FILEHANDLE $content;

close FILEHANDLE;

. add

ress

. is. cal

led

. into. the. sub

routine

. and. con

tent.

. is. sub

routine

. use

. “ge

t”

. fun

ction

. fro

LWP

::Simple

.to.cop

.the.web.sou

rce

.into.the.var

iable

.$co

ntent,

.and.the

.the.con

tent

.of.thi

.web.pag

.is.

stored.into.the.le.name.html.. e.nal.result.will.be.a.le.having.the.same.content.as.the.web.page.

htt

p://www.cpan.org/doc/FAQs/index.html.

Instead

.of.usin

.LWP

::Simple

.to.emu

late

.a.bro

wser,

.we.may.als

.use.the.wge

.sys

tem

.cal

.GNU.wge

is.an.ope

.sou

rce

.so

ware

.pac

kage

.for.ret

rieving

.le

.usin

.HTT

PS,

.and.FTP

.the.mos

.wid

ely-

used

.Int

ernet

.pro

tocols.

.Its.mai

.fun

ction

.is.to.lin

.a.cer

tain

.web.pag

.wit

.an.add

ress

.inp

.and.cop

all.web.sou

rces

.of.tha

.web.pag

.into.a.le

.It.all

ows

.use

.to.log.o.fro

.the.sys

tem

.and.let.wge

.ni

its.wor

. is.is.ext

remely

.ee

ctive

.and.tim

e-saving

.whe

.use

.hav

.to.tra

nsfer

.a.lot.of.dat

.fro

.di

er-

ent

.Web.lin

ks.

.In.con

trast,

.oth

.web.bro

wsers

.alw

ays

.req

uire

.use

rs’

.con

stant

.pre

sence.

.Gen

erally,

.wge

wor

.alm

ost

.the.sam

.as.the.bro

wser

.bui

.fro

.LWP

::Simple

.mod

ule.

.How

ever,

.it.giv

.use

.mor

opti

ons

.[W

SC05].

Below

.is.the.basi

.str

ucture

.to.cal

.wge

.fro

.a.PER

.scr

ipt.

.“–O

”

.mea

.tha

.doc

uments

.wil

.not.be.

wri

tten

.to.sep

arate

.le

.but.all.wil

.be.con

catenated

.toge

ther

.and.wri

tten

.to.one.le.whi

.“–q

”

.tur

.o.

wge

.ou

tput

.to.th

.pr

ompt

.sc

reen.

$add= ="http://www.cpan.org/doc/FAQs/index.html";

$fname= "filename.htm";

system("wget.exe", "-q", "-O", $fname,$add);

.assi

gning

.val

ues

.to.the.var

iables

.$ad

.and.$fn

ame

.as.an.add

ress

.of.a.web.pag

.and.a.nam

.of.a.le.

and.usin

.the.“sy

stem”

.com

mand,

.the.new.htm

.le.wil

.con

tain

.the.sam

.con

tent

.as.tha

.web.lin

.Onc

the.new.htm

.le.con

tains

.all.dat

.tha

.use

.wan

.the

.can.ope

.and.cop

.thi

.dat

.into.an.arr

ay.

.Fro

her

.us

ers

.ca

.ex

tract

.al

.in

formation

.th

.wa

.by.usi

.PE

.co

mmands.

66-4 Industrial Communication Systems

66.2 Examples

66.2.1 Extract E-Mail addresses from Excel Files

An.excel.le.has.three.columns:.the.rst.is.the.order.number,.the.second.contains.the.e-mail.addresses.

of.the.auth

ors,

.and.the.thir

.disp

lays

.the.cate

gories

.of.the.auth

or’s

.inte

rest.

.In.this.exam

ple,

.ther

.are.

seve

.auth

ors

.who.are.inte

rested

.in.thre

.cate

gories:

.powe

.elec

tronic

.conv

erters,

.signa

.proc

essing,

.and.

neur

.netw

orks.

.Assu

.that.you.want.to.call.for.pape

.on.neur

.netw

orks

.by.send

ing

.an.e-ma

.to.

thes

.aut

hors.

.Our.wor

.is.to.ext

ract

.e-m

ail

.add

resses

.of.the

.aut

hors

.fro

.the.tab

.(Ta

ble

.66.

1).

 ere

.are.many.ways.to.get.this.job.done

. e.trad

itional

.way.is.to.copy.this.exce

.le.into.a.text.le.

and.use.regu

lar

.expr

essions

.to.extr

act

.the.desir

.data

. is.work.beco

mes

.dic

ult

.and.comp

licated

if.the.exce

.le.has.more.colu

mns.

.Howe

ver,

.it.can.be.much.simpl

.with.PERL.by.using.the.modu

“Win3

2::OLE.”

. is.pack

age

.is.not.incl

uded

.in.the.stan

dard

.PERL.libr

ary

.but.can.be.down

loaded

.from.

CPAN

.What.it.does.is.to.open.an.exce

.le,.but.a.le.has.many.die

rent

.shee

ts,

.user

.have.to.den

whic

.shee

.need.to.be.open

.by.modi

fying

.the.shee

.numbe

.or.the.shee

.name

.Once.this.shee

is.open

ed,

.each.colu

.can.be.save

.into.die

rent

.arra

ys.

.From.thes

.arra

ys,

.the.e-ma

.addr

esses

.of.

auth

ors

.int

erested

.in.neu

ral

.net

works

.can.be.ret

rieved

.(Ta

ble

.66.

2).

use Win32::OLE qw(in with);

use Win32::OLE::Const 'Microsoft Excel';

$Win32::OLE::Warn = 3;# die on errors…

$mydir='C:/ALL BACK UP/Industrial Electronics on Trans/';

$filename=$mydir."IESdatabase08.xls";

if (-e "$filename")

{

# get active Excel application or open Excel application

my $Excel = Win32::OLE->

GetActiveObject('Excel.Application')

|| Win32::OLE->new('Excel.Application', 'Quit');

$Excel->{'Visible'} = 0; #opened file is visible

# open Excel file

my $Book = $Excel->Workbooks->Open("$filename");

# select worksheet number 2 (you can also select a

worksheet by name)

my $Sheet = $Book->Worksheets(2);

# count the number of columns

my $LastCol = $Sheet->UsedRange->Find({What=>"*",

SearchDirection=>xlPrevious,

SearchOrder=>xlByColumns})->{Column};

# count the number of rows

my $LastRow = $Sheet->UsedRange->Find({What=>"*",

SearchDirection=>xlPrevious,

SearchOrder=>xlByRows})->{Row};

$totalrow=$LastRow;

foreach my $row (1..$LastRow)

{

foreach my $col (1..$LastCol)

{

next unless defined

$Sheet-> Cells(1,$col)->{'Value'};

Automatic Data Mining on Internet by Using PERL Scripting Language 66-5

$title_row=$Sheet->Cells(1,$col)->{'Value'};

#extract manuscript and save in an array

if ($title_col=∼ m/Manuscript/)

{$area[$row-1]=$Sheet->Cells($row,$col)

->{'Value'};}

#extract email and save in an array

if ($title_col =∼ m/Email Address/)

{$email[$row-1]=$Sheet->Cells($row,$col)

->{'Value'};}

}

$Excel->Quit();

}

for($n=0;$n<$LastRow;++$n) //search data from saved arrays

{

if ($area[$n]=∼ m/Neural Networks/)

{print ("$email[$n]\n");}

}

Result

66.2.2 Extract Data from PDF Files

In.data.mining,.we.encounter.dierent.types.of.data.in.dierent.formats;.data.could.be.in.PDF.format,.

Doc.for

mat,

.etc

. e.iss

.her

.is.tha

.the

.typ

.of.dat

.hav

.to.be.con

verted

.into.the.gen

eral

.tex

for

mat

.tha

.can.be.rea

dable

.and.reu

sable.

. er

.are.two.sol

utions

.to.han

dle

.thi

.pro

blem,

.one.is.don

man

ually

.an

.th

.ot

her

.is.do

.au

tomatically.

With

.the.man

ual

.sol

ution,

.use

.hav

.to.cop

.and.pas

.fro

.the.PDF.for

mat

.to.the.tex

.for

mat.

How

ever,

.thi

.sol

ution

.is.tim

e-consuming

.and.imp

ractical

.as.the.numb

.of.PDF.doc

umentations

.is.

sca

led

.up..Use

.can.cal

.wge

.to.ope

.the.PDF.le.and.cop

.its.con

tent

.into.the.tex

.le.as.the

.oe

.use.

to.han

dle

.tex

.le.or.htm

.le

.but.the.res

ult

.le.wil

.be.cor

rupted

.in.thi

.way

.Bec

ause

.of.thi

.pro

blem,

the.st

raight

.so

lution

.is.no

.ap

plicable.

With

.the.auto

matic

.sol

ution,

.the.wor

.can.be.don

.in.a.muc

.simp

ler

.way

.In.ord

.to.do.tha

.use

hav

.to.use.the.mod

ule

.CAM

::PDF

.in.the

.cod

. is.mod

ule

.all

ows

.use

.to.con

vert

.the.PDF.le.int

TABLE 66.1 Excel.le

Email.Address Manuscript

yuebook@yahoo.cn Power

.Ele

ctronic

.Co

nverters

tomfangok@126.com Signal

.Pr

ocessing

xmsun.whu@163.com Power

.Ele

ctronic

.Co

nverters

Hubert.RAzik@green.uhp-nancy.fr Signal

.Pr

ocessing

eexma10@nottingham.ac.uk Power

.Ele

ctronic

.Co

nverters

xu.tao.dragon@gmail.com Neural

.Net

works

raky829@gmail.com Neural

.Net

works

TALE 66.2 Result.le.displayed.in.the.table

Email.Address Manuscript

xu.tao.dragon@gmail.com Neural

.Net

works

raky829@gmail.com Neural

.Net

works

66-6 Industrial Communication Systems

a.text.le.without.corruption..In.this.way,.users.can.preserve.the.original.data.as.given.in.the.PDF..When.

dat

.is.co

nverted,

.it.is.st

ill

.re

usable.

use CAM::PDF;

use CAM::PDF::PageText;

$filename = "C:/ALL BACK UP/Hung Database/filename.pdf";

my $pdf = CAM::PDF->new($filename);

my $pageone_tree = $pdf->getPageContentTree(1);

open TEST, ">", "test.txt" or die $!;

print TEST CAM::PDF::PageText->render($pageone_tree);

close TEST;

66.2.3 Extract Paper Information from IEEE XPLOrE

PERL.is.used.not.only.to.mine.data.from.les.in.dierent.formats,.but.also.to.extract.data.directly.from.

the.web.thr

ough

.a.net

work

.con

nection.

. e.nam

.for.thi

.fun

ctionality

.is.Int

ernet

.rob

.(IR

.Any.IR.

can.be.con

nected

.to.ser

vers

.rem

otely

.by.emb

edding

.mod

ules

.suc

.as.LWP

::Simple,

.LWP

::UserAgent,

or.wge

.int

.it.. e.acc

uracy

.and.spe

.of.min

ing

.dat

.mak

.thi

.met

hod

.bec

ome

.spe

cial

.in.pro

cess-

ing

.and.ext

racting

.dat

.fro

.the.Int

ernet.

For

.thi

.par

ticular

.app

lication,

.the.IR.acc

esses

.XPL

ORE

.and.dow

nloads

.all.the.inf

ormation

.abo

.the.

pap

ers

.stor

.in.the.ser

ver.

. en.it.ext

racts

.all.desi

red

.inf

ormation

.abo

.aut

hors,

.tit

les,

.pag

.numb

er,

etc

.and.put

.the

.toge

ther

.in.an.htm

.for

mat

.tha

.is.mor

.hum

.rea

dable

.tha

.the.raw.dat

.To.be.abl

to.ext

ract

.all.inf

ormation

.und

.di

erent

.lin

ks,

.wge

.has.to.sea

rch

.and.ext

ract

.all.hyp

erlinks

.(Fi

gures

66.

.an

.66

.2).

66.2.4 List Papers Only in a Specic Subject from tIE Webpage

In.this.example,.the.IR.will.browse.the.TIE.web.page.and.extract.papers.about.“neural.network.”.Aer.

dow

nloading

.dat

.fro

.the.ser

ver,

.the.IR.wil

.sav

.all.inf

ormation

.in.an.arr

ay,

.whe

.eac

.lin

.of.the.

web.sou

rce

.wil

.be.an.ind

.of.the.arr

ay.

.By.usi

.reg

ular

.exp

ressions

.to.mod

ify

.the.ind

exes

.con

tain-

ing

.the.tit

.and.com

pare

.wit

.the.pat

tern

.“ne

ural

.net

work,”

.the.IR.wil

.lis

.all.pap

ers

.abo

.“ne

ural

net

work”

.(Fi

gure

.66.

3).

FIGURE 66.1 A.single.link.with.all.extracted.information.

Automatic Data Mining on Internet by Using PERL Scripting Language 66-7

$mydir="C:/ALL BACK UP/Hand Book/";

$add="http://tie.ieee-ies.org/tie/abs/56s.htm";

//copy website source into a local file

$fname= "handbook.htm";

system("wget.exe", "-q", "-O", $fname,$add);

$file=$mydir."handbook.htm";

open(r1,"<$file");

@lines = <r1>;

close(r1);

$N=@lines;

$j=0;

// search array indexes containing 'neural networks'string

for($i=0;$i<$N;++$i)

{

//transfer uppercase letters into lowercase letters

$lines[$i] =∼ tr/[A-Z]/[a-z]/;

FIGURE 66.2 Web.page.with.links.generated.by.the.IR.

FIGURE 66.3 Papers.about.neural.network.

66-8 Industrial Communication Systems

//search 'neural network'

if(

($lines[$i]=∼ m/<td valign/)&&($lines[$i]=∼ m/neural

network/) )

{ $a[$j]="<tr>".$lines[$i]."</td>"."</tr>";

$j=$j+1;}

}

Result:

66.2.5 Using PErL with Google Scholar in Searching Data

Google.Scholar.is.as.easy.to.use.as.the.normal.Google.Web.search.can.be,.especially.with.the.helpfulness.

of.the.“advanced.search”.option,.which.can.automatically.narrow.search.results.to.a.specic.journal.

or.article.. e.most.relevant.results.for.searched.keywords.will.be.listed.rst,.in.order.of.the.authors.

ranking,.the.amount.of.references.that.are.linked.to.it.and.their.relevance.to.other.scholarly.literature,.

and.the.ranking.of.the.publication.that.the.journal.appears.in.and.the.citation.index.. e.IR.can.be.

incorporated.with.this.search.engine.to.search.for.information.about.authors,.citations,.etc..With.this.

type.of.searching,.the.IR.can.take.advantage.of.the.search.engine.Google.Scholar,.which.is.relatively.

quick.and.easy.to.use.. e.searching.process.can.be.modeled.as.following.(Figure.66.4):.input.key-

words

.from.users,.which.can.be.journal.name,.year.of.published.article,.etc..When.these.keywords.are.

dened,.the.IR.will.activate.the.search.engine.as.Google.Scholar,.Web.of.Knowledge,.etc.,.and.search.for.

selected.information,.then.generate.the.output.le..For.example,.if.information.about.authors,.citations.

of.Journal IEEE on Transactions Industrial Electronics.in.the.year.2006.is.required,.users.can.dene.the.

keywords.by.using.this.journal.name.and.the.given.year.to.activate.the.search.engine.Google.Scholar..

 e.IR.will.copy.all.information.about.papers.on.this.journal.in.this.year.through.Google.Scholar..When.

the.extracting.process.is.complete,.the.text.le.output.will.be.generated.(Figure.66.5)..With.this.type.

of.concept,.there.are.many.applications.where.users.can.benet.from.a.Robot.. e.searching.process.is.

optimized.and.time-saving.

66.3 Summary and Conclusion

Current.tools.that.enable.data.extraction.or.data.mining.are.both.expensive.to.maintain.and.complex.

to.design.and.use.due.to.several.potholes.such.as.dierence.in.data.formats,.varying.attributes,.and.

typographical.errors.in.input.documents..One.such.tool.is.an.Extractor.or.Wrapper,.which.can.perform.

the.data.extraction.and.processing.tasks.[CKGS06]..Wrapper.induction.based.on.inductive.machine.

learning.is.the.leading.technique.available.nowadays.. e.user.is.asked.to.label.or.mark.the.target.items.

in.a.set.of.training.pages.or.a.list.of.data.records.in.one.page.. e.system.then.learns.extraction.rules.

from.these.training.pages..Inductive.learning.poses.a.major.problem—the.initial.set.of.labeled.training.

Input keywords Internet robot Search engine Output

FIGURE 66.4 Searching.process.model.

FIGURE 66.5 Output.le.